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Abstract 

Organizational  structure  builds  the  foundation  from  which  organizations  operate. 
To  gain  full  potential  of  structural  efficiencies  in  the  current  operating  environment, 
public  and  private  firms  are  continually  modifying  their  organizational  structure.  The 
U.S.  Air  Force  is  no  different  and  underwent  its  most  recent  reorganization  in  the  fall  of 
2002  replaeing  the  post-Gulf  War  format  of  the  previous  decade.  Air  Force  leadership 
needs  to  understand  how  well  the  current  structure  is  performing  at  achieving  its  intended 
objectives. 

This  research  investigates  the  effeetiveness  of  the  recent  change  to  Air  Force 
organizational  structure  on  aircraft  maintenance  performance  through  an  analysis  of 
aircraft  maintenance  metries.  To  observe  effects  both  within  and  across  the  Air  Force, 
four  years  of  data  were  analyzed  from  three  F-16  units  and  three  KC-135  units 
representing  two  of  the  signifieant  Air  Force  Major  Commands  (MAJCOMs).  The 
analytieal  methods  used  for  this  researeh  inelude  testing  assumptions  of  normality  and 
variance  of  sample  data.  Next,  homogeneity  of  variance  and  comparison  of  means  tests 
were  used  to  identify  significant  differences  between  data  of  pre-  and  post-combat  wing 
structures.  Then,  the  direction  of  any  noted  changes  was  made  apparent  and  eategorized 
for  quantification  using  weighted  factor  analysis.  Finally,  trend  analysis  was  performed 
to  assist  in  determining  overall  effectiveness  of  the  combat  wing  structure.  Results  of 
this  analysis  allowed  the  researcher  to  postulate  an  answer  to  the  overall  research 
question.  This  answer  and  other  assoeiated  findings  ean  assist  Air  Force  leaders  in 
understanding  how  to  enhance  operational  performance. 


IV 


Acknowledgments 


I  would  like  to  express  my  appreciation  to  my  thesis  committee  members,  Lt  Col 
Stephan  Brady  and  Lt  Col  Marvin  Arostegui,  for  their  guidance  and  support  throughout 
the  research  process.  I  would  also  like  to  show  appreciation  to  statistical  expert  Major 
Timothy  Webb  for  his  assistance  in  the  performance  of  the  analytical  portions  of  this 
research. 

Additionally,  I  would  like  to  extend  thanks  to  SMSgt  Singletary  from  HQ 
ACC/LGP,  TSgt  Lynch  from  HQ  AMC/A44QA,  Mr.  Richard  Enz  from  the  REMIS 
Program  Office,  and  the  "Warriors  of  the  North"  from  Grand  Porks  APB,  ND  for 
providing  me  with  the  valuable  data  necessary  to  conduct  this  research. 

Pinally,  I  would  like  to  extend  my  gratitude  to  my  friends  and  family  members  for 
their  support  and  encouragement  throughout  this  and  all  of  my  past  accomplishments. 
Special  recognition  is  necessary  for  Jeff  Eudwig  (USMC,  Ret.),  Jim  Cooksey,  Steve 
Chicosky,  Keith  Eewis,  and  my  wife.  Without  all  of  them,  the  road  to  my 
success  would  have  been  all  up  hill. 


Derrick  R.  Barthol 


V 


Table  of  Contents 

Page 

Abstraet . iv 

Aeknowledgments . v 

List  of  Figures . viii 

List  of  Tables . ix 

1.  Introduetion . 1 

Baekground . 1 

Problem  Statement . 3 

Researeh  Question . 3 

Investigative  Questions . 3 

Methodology . 4 

Seope  and  Limitations . 4 

Assumptions  and  Confounding  Faetors . 5 

Summary . 5 

IF  Literature  Review . 7 

Introduetion . 7 

Organizational  Theory . 7 

Air  Foree  Struetures . 12 

Aireraft  Maintenanee  Performanee  Measurements . 17 

Previous  Research . 20 

Summary . 23 

III.  Methodology . 24 

Purpose  Statement . 24 

Research  Paradigm . 24 

Theoretical  Model . 25 

Population  and  Sample  Selection . 25 

Variable  Selection . 26 

Data  Collection . 29 

Time  Interval . 30 

Statistical  Tools . 30 

Analysis  Methods . 31 

Confounding  Factors . 37 

Summary . 39 

IV.  Data  Analysis  and  Results . 40 

Overview . 40 

vi 


Analysis  Results . 40 

Normality  Tests . 41 

Varianee  Tests . 45 

Comparison  of  Means  Tests . 50 

Qualitative  Summary  Results . 56 

Trend  Analysis . 64 

Summary . 71 

V.  Conelusions  and  Reeommendations . 72 

Introduetion . 72 

Conelusions . 72 

Reeommendations  from  Analysis . 74 

Reeommendations  for  Future  Researeh . 74 

Summary . 75 

Appendix  A  -  Primary  Maintenanee  Metries  (as  deseribed  in  AFI  21-101) . 76 

Appendix  B  -  Previous  Researeh  Variables . 82 

Appendix  C  -  Maintenanee  Metrics  Comparison  Table . 83 

Appendix  D  -  Data  Tables . 84 

Appendix  E  -  Normality  Test  Results . 90 

Appendix  F  -  Variance  Test  Results . 93 

Appendix  G  -  Comparison  of  Means  Analysis  Results . 99 

Appendix  H  -  Qualitative  Data  Plots . 105 

Appendix  I  -  Trend  Analysis  Results . 107 

Appendix  J  -  Time  Series  Plots . 119 

Bibliography . 161 

Vita 


vii 


163 


List  of  Figures 


Page 

Figure  1.  Organizational  Strueture  Domain . 8 

Figure  2.  Example  of  Vertical  Structure . 9 

Figure  3.  Example  of  Horizontal  Structure . 10 

Eigure  4.  Example  of  Eunctional  Structure . 11 

Eigure  5.  Example  of  Product/Service  Structure . 11 

Eigure  6.  Objective  Wing  Structure  (AEI  38-101,  Eig  3.5) . 14 

Eigure  7.  Operations  Squadron  Structure  (AEI  38-101,  Eig  3.11) . 15 

Eigure  8.  Combat  Wing  Structure  (PAD  02-05,  Appendix  I  to  Annex  A) . 16 

Eigure  9.  Research  Variables . 28 

Eigure  10.  E-16  Sensitivity  Analysis  of  Weighted  Variance . 62 

Eigure  11.  KC-135  Sensitivity  Analysis  of  Weighted  Variance . 63 

Eigure  12.  Overall  Sensitivity  Analysis  of  Weighted  Variance . 64 


viii 


List  of  Tables 

Page 

Table  1.  Time  Interval . 30 

Table  2.  Desired  Direetion  of  Change  in  Mean  Value . 33 

Table  3.  Weighted  Faetor  Scale . 35 

Table  4.  20FW  Shapiro-Wilk  Normality  Test  Results . 41 

Table  5.  27FW  Shapiro-Wilk  Normality  Test  Results . 42 

Table  6.  388FW  Shapiro-Wilk  Normality  Test  Results . 43 

Table  7.  22ARW  Shapiro-Wilk  Normality  Test  Results . 43 

Table  8.  92ARW  Shapiro-Wilk  Normality  Test  Results . 44 

Table  9.  3 19ARW  Shapiro-Wilk  Normality  Test  Results . 45 

Table  10.  20FW  Levene  Homogeneity  of  Variance  Test  Results . 46 

Table  11.  27FW  Levene  Homogeneity  of  Variance  Test  Results . 47 

Table  12.  388FW  Levene  Homogeneity  of  Variance  Test  Results . 48 

Table  13.  22ARW  Levene  Homogeneity  of  Variance  Test  Results . 48 

Table  14.  92ARW  Levene  Homogeneity  of  Variance  Test  Results . 49 

Table  15.  319ARW  Levene  Homogeneity  of  Variance  Test  Results . 50 

Table  16.  20FW  Means  Comparison  Test  Results . 52 

Table  17.  27FW  Means  Comparison  Test  Results . 52 

Table  18.  388FW  Means  Comparison  Test  Results . 53 

Table  19.  22ARW  Means  Comparison  Test  Results . 54 

Table  20.  92ARW  Means  Comparison  Test  Results . 55 

Table  21 .  3 19ARW  Means  Comparison  Test  Results . 55 

Table  22.  F-16  MeansWariance  Summary  Results . 57 

Table  23.  F-16  Weighted  Factor  Results . 58 

Table  24.  KC-135  MeansWariance  Summary  Results . 59 


Table  25.  KC-135  Weighted  Faetor  Results . 60 

Table  26.  Overall  MeansWarianee  Summary  Results . 60 

Table  27.  Overall  Weighted  Faetor  Summary  Results . 61 

Table  28.  20FW  Trend  Analysis . 65 

Table  29.  27FW  Trend  Analysis . 66 

Table  30.  388FW  Trend  Analysis . 67 

Table  3 1 .  22ARW  Trend  Analysis . 68 

Table  32.  92ARW  Trend  Analysis . 68 

Table  33.  319ARW  Trend  Analysis . 69 

Table  34.  Overall  Trend  Analysis  Results . 70 


X 


AN  ANALYSIS  INTO  THE  EFFECTIVENESS  OF  AIRCRAFT  MAINTENANCE 
UNDER  THE  COMBAT  WING  STRUCTURE 


I.  Introduction 


Background 

"Restructure,"  "reorganization,"  and  the  most  recently  used  "transformation"  are 
all  words  not  uncommon  to  members  of  every  Air  Force  organization.  If  not  for  the 
implementation  of  change,  the  Air  Force  would  not  exist  as  a  separate  service  today. 
Beginning  in  1907  when  the  first  Aeronautical  Division  was  formed  by  the  U.S.  Army 
Signal  Corps,  the  chronology  of  military  aviation  is  defined  by  patterns  of  change.  "The 
Air  Force  enjoys  an  unprecedented  level  of  organizational  flexibility  that  originated  in  its 
common  heritage.  Airmen  expect  change,  look  forward  to  it,  and  thrive  on  it."  (Deptula, 
2001:87).  Dramatic  changes  in  the  world  relating  to  military  function  and  national 
security  are  motivating  factors  toward  organizational  change  and  were  readily  apparent 
throughout  the  decade  following  the  Persian  Gulf  conflict  of  the  early  1990's. 

Since  the  reorganization  of  the  Air  Force  in  1992  and  subsequent  downsizing  of 
personnel,  operations  in  maintaining  stability  in  the  Middle  East  continued  along  with 
humanitarian  and  peacekeeping  operations  in  places  like  Somalia,  Rwanda,  Haiti,  and  the 
Balkans  (Benson,  1997).  The  Air  Force  also  played  a  role  in  the  air  campaign  to  end 
civil  war  in  Bosnia  in  late  1995  and  implemented  the  Expeditionary  Air  Force  (EAF) 
concept  in  that  same  year.  Since  then,  the  service  has  been  maintaining  an  increased 
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level  of  deployed  troops  throughout  the  world.  To  further  enhance  operations  during  this 
new  and  ever  changing  global  environment,  leadership  directed  its  focus  on  the  logistics 
efforts  under  the  Chief  of  Staff  of  the  Air  Force  Logistics  Review  (CLR)  in  September  of 
1999.  The  CLR  sought  to  concentrate  on  wing-level  process  improvements  while 
balancing  operations  with  EAF  objectives  (Zettler,  2001).  Processes  requiring  attention 
were  recognized  from  inputs  made  by  MAJCOMs  and  Air  Force  directed  research 
agencies.  These  processes  were  categorized  into  four  main  focus  areas:  Training  and 
officer  development,  Supply  and  Transportation  management.  Logistics  plans,  and 
Aircraft  maintenance.  Of  the  423  core  CLR  issues  identified,  over  50  percent  were 
related  to  the  aircraft  maintenance  discipline  which  became  the  focus  of  this  research. 

Recommendations  and  implementation  steps  toward  improvement  were 
developed  and  presented  to  leadership  in  the  fall  of  2000  (Hall,  2002).  From  these, 
initiatives  in  aircraft  maintenance  were  directed  at  concerns  for  sortie  production  and 
health  of  fleet  issues.  Included  in  the  aspect  of  long-term  fleet  health  was  a  focus  on 
maintenance  metrics  and  alignment  of  "core  functions"  under  a  common  group-level 
organization.  Transformational  test  phases  for  implementing  a  new  organizational 
structure  were  put  into  place  in  early  2001 .  Later  that  year,  the  events  surrounding  the 
September  11th  terrorist  attacks  further  advanced  the  direction  necessary  for  future  Air 
Force  operations.  In  April  2002,  General  John  Jumper,  Chief  of  Staff  of  the  Air  Force 
(CSAF),  directed  an  Air  Force-wide  wing-level  reorganization  to  take  effect  on  October 
1st  of  that  year.  Under  this  new  arrangement  known  as  the  "Combat  Wing  Structure", 
aircraft  maintenance  functions  would  be  aligned  under  a  dedicated  maintenance  group 
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commander  in  an  effort  to  enhance  eore  competencies,  improve  aireraft  sortie  production, 
and  fleet  health. 

Problem  Statement 

Senior  Air  Force  leaders  need  to  know  how  well  the  new  combat  wing  structure  is 
performing  at  achieving  the  intended  objeetives  of  aireraft  maintenance  organizations. 
This  research  seeks  to  identify  the  impact  of  the  combat  wing  structure  by  detecting 
changes  in  aircraft  maintenance  performance  metrics  as  a  measure  of  effectiveness. 

Research  Question 

This  research  seeks  to  answer  the  question,  "How  effeetive  has  the  new  combat 
wing  structure  been  at  meeting  the  intended  objectives  set  forth  for  aircraft  maintenance 
organizations?" 

Investigative  Questions 

In  order  to  suceessfully  meet  the  research  objective,  the  following  investigative 
questions  must  be  addressed: 

1 .  What  are  the  driving  reasons  behind  and  objectives  of  the  Air  Force's 
implementation  of  the  combat  wing  structure? 

2.  How  can  these  objectives  be  measured? 

3.  What  were  the  performanee  measurements  prior  to  implementation? 

4.  What  are  the  performance  measurements  after  implementation? 

5.  Are  there  significant  differences  between  pre-  and  post-implementation 
performance  measurements? 

6.  What  other  explanations  exist  as  confounding  variables  in  the  analysis  of  the 
data? 
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Methodology 

This  study  investigates  the  theory  that  organizational  structure  may  or  may  not 
influence  the  effectiveness  of  aircraft  maintenance  through  its  impact  on  maintenance 
performance  metrics.  First,  a  comprehensive  review  of  the  literature  sets  a  basis  for  the 
types  of  organizational  structures,  both  internal  and  external  to  the  Air  Force.  It  also 
identifies  the  driving  reasons  for  the  Air  Force's  most  recent  reorganization  and  builds  a 
framework  of  principal  factors  used  to  measure  aircraft  maintenance  performance.  This 
information  then  dictates  the  types  of  data  to  collect  and  the  statistical  methods  used  in 
analyzing  data  from  both  pre-  and  post- implementation  phases.  Tests  for  normality  and 
homogeneity  of  variance  are  first  performed  to  overcome  basic  assumptions  necessary  for 
further  analysis.  Then,  variance  tests  and  comparison  of  means  are  used  as  the  primary 
analysis  tools  to  identify  whether  or  not  a  significant  difference  exists  between  data  sets. 
Next,  weighted  factor  analysis  is  applied  to  quantify  results  obtained  in  the  previous  tests. 
Finally,  trend  analysis  is  used  to  assist  in  making  a  final  deduction  of  the  effectiveness  of 
aircraft  maintenance  under  the  new  combat  wing  structure. 

Scope  and  Limitations 

This  research  is  limited  to  the  effects  of  the  Air  Force  reorganization  on  wing- 
level  organizations  chosen  for  analysis.  The  results  and/or  methodologies  may  not  be 
applicable  to  other  aircraft  maintenance  organizations  within  the  Air  Force.  Also,  results 
are  based  on  the  quantitative  variables  selected  as  a  measurement  of  aircraft  maintenance 
performance.  Altering  these  variables  may  produce  different  results.  A  third  limitation 
of  this  research  is  the  dependency  on  accurate  data  entry.  As  with  all  statistical  analysis, 
the  resulting  output  is  limited  by  the  quality  of  the  input  data  used  during  the  analysis.  A 
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final  identifiable  limitation  of  this  research  is  based  on  the  timeframe  of  data  collection. 


Both  the  period  over  which  data  was  collected  and  the  maturity  of  each  organizational 
structure  at  the  time  of  collection  may  influence  analysis  results. 

Assumptions  and  Confounding  Factors 

In  performing  this  research,  some  general  assumptions  must  be  made  regarding 
the  data  and  the  analysis  methods  used.  The  first  assumption  concerns  the  accuracy  of 
data  retrieved  from  the  numerous  maintenance  information  systems  used  by  the  Air 
Force.  These  systems  are  identified  as  the  primary  data  collection  tools  containing  the 
most  comprehensive  and  accurate  data  used  by  maintenance  managers  at  all  levels.  Next, 
data  obtained  across  separate  time  segments  and  geographic  locations  were  assumed  to  be 
independent  from  one  another.  This  was  done  since  the  actions  of  any  certain  sample  set 
did  not  influence  the  actions  or  results  of  any  other  sample  set.  Additionally,  there  are 
common  assumptions  required  when  performing  statistical  analysis.  These  assumptions 
are  described  and  tested  during  the  analysis  portion  of  this  research.  A  final  assumption 
made  involves  confounding  factors.  Confounding  factors  are  those  items  that  may  have 
influenced  the  data  and/or  the  analysis  results,  but  were  difficult  or  unable  to  account  for. 
These  factors  include  items  such  as  operational  tempo,  leadership  changes,  and  others. 
Additional  detail  about  confounding  factors  applicable  to  this  research  and  the  attempts 
made  to  reduce  their  impact  are  described  in  a  later  chapter. 

Summary 

This  chapter  presented  the  background  and  problem  statement  surrounding  the 
reasons  for  conducting  this  research.  It  also  defined  the  research  question  and 
investigative  questions  that  will  be  used  in  positing  answers  to  the  problem.  A  brief 
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overview  of  the  methodology  for  the  research  was  included  along  with  a  summary  of  the 
associated  shortcomings  and  limitations. 

Chapter  2,  Literature  Review,  identifies  information  found  in  published  literature 
relating  to  organizational  structure  and  maintenance  performance  measurements.  It  also 
defines  work  performed  by  previous  researchers  in  an  effort  to  use  their  findings,  short¬ 
comings,  and  suggestions  in  conducting  an  effective  study. 

Chapter  3,  Methodology,  provides  insight  into  the  methods  used  when  conducting 
this  research.  It  outlines  the  purpose  and  model  used  along  with  the  integral  components 
necessary  for  meaningful,  high  quality  research. 

Chapter  4,  Analysis  and  Results,  utilizes  the  methods  and  information  previously 
outlined  in  conducting  the  actual  data  analysis.  It  includes  the  individual  statistical  tests 
performed  and  the  results  obtained  for  each  of  the  selected  samples. 

Chapter  5,  Conclusions  and  Recommendations,  presents  a  collective  answer  to  the 
research  objective  and  discloses  specific  findings  made  while  conducting  this  research.  It 
also  provides  recommendations  from  these  results  and  addresses  associated  areas  for 
possible  future  research. 
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II,  Literature  Review 

Introduction 

This  chapter  summarizes  the  foundational  literature  used  in  this  researeh  to 
establish  the  basie  theory  of  organizational  strueture  and  deseribe  the  Air  Foree's 
evolutionary  struetural  ehanges.  It  also  presents  material  deseribing  aireraft  maintenanee 
performanee  measures  used  in  determining  the  effeetiveness  of  the  most  reeent  ehange  to 
organizational  structure.  Finally,  it  provides  a  brief  overview  of  the  methods  and 
outcomes  from  previous  researeh  performed  regarding  aireraft  maintenanee  performanee 
and  organizational  strueture. 

Organizational  Theory 

The  subjeet  of  organizational  strueture  has  long  been  a  topie  reviewed  and 
analyzed  by  business  leaders  and  edueational  seholars  alike.  When  establishing  an 
appropriate  strueture  or  contemplating  a  change  to  an  existing  strueture,  one  must  first 
understand  the  fundamentals  of  organizational  theory  along  with  the  benefits  and 
detriments  assoeiated  with  eaeh  (Hall,  2002).  In  assoeiation  with  these  coneepts,  one 
must  also  eonsider  how  structure  supports  the  mission  and  strategy  of  the  organization, 
whether  or  not  the  strueture  provides  the  best  use  of  personnel  and  resourees,  and  if  it 
will  perform  in  the  most  effieient  and  effeetive  manner. 

Investigation  of  the  published  literature  identified  two  main  dimensions  when 
eharaeterizing  struetural  arrangements  within  an  organization  as  shown  in  Figure  1.  The 
first  involves  the  type  of  organizational  eontrol  and  hierarehy  in  whieh  the  organization 
will  operate.  Hall  (2002)  identifies  how  these  struetures  range  from  a  traditional  vertieal 
arrangement  built  like  pyramid,  to  a  more  horizontal  or  flat  arrangement.  The  differenees 
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in  these  arrangements  involve  the  issues  of  centralization  of  authority,  communication, 
and  control  throughout  each  level  of  the  organization.  The  second  area  of  consideration 
when  adopting  an  organizational  structure  revolves  around  the  focus  of  the  organization. 
This  focus  may  be  directed  toward  the  functions  of  the  organizational  units  or  around  the 
products  and/or  services  the  organization  provides  (Hall,  2002).  Descriptions  of  both 
vertical  and  horizontal  arrangements,  along  with  the  functional  and  product/service 
oriented  structures  are  provided  in  the  subsequent  paragraphs. 


Vertical 
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Figure  1 .  Organizational  Structure  Domain 


Vertical  Structure.  Within  a  vertical  arrangement,  leadership  is  centered  on  a 
single  entity  at  the  top  of  a  hierarchical  pyramid  and  is  directed  downward  through 
several  layers  of  management  (Hall,  2002).  At  each  level,  authority  is  given  over  only 
those  agencies  directly  overseen  by  the  management  head.  Communication  and  control 
is  centralized  within  a  top-to-bottom  arrangement  of  executives  and  managerial  levels 
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providing  immediate  aecountability  for  the  performanee  of  eaeh  organizational  division. 
Figure  2  provides  a  graphieal  example  of  the  typieal  vertieal  organization. 


Figure  2.  Example  of  Vertieal  Structure 


Horizontal  Structure.  At  the  other  extreme  is  the  horizontal  or  flat  organizational 
structure.  Under  this  type  of  arrangement,  managerial  levels  are  significantly  reduced 
and  authority  is  more  decentralized  across  multiple  levels  of  leadership  (Hall,  2002). 
Communication  across  levels  is  essential  and  the  span  of  control  gained  by  management 
becomes  wider.  Personnel  working  within  a  horizontal  structure  are  required  to 
understand  more  about  the  functions  of  other  agencies  within  the  organization  and  work 
in  parallel  with  the  goals  of  those  agencies.  An  example  of  the  horizontal  structure  is 
portrayed  in  Figure  3. 
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Figure  3.  Example  of  Horizontal  Structure 

When  choosing  either  a  vertical  or  horizontal  structural  arrangement,  one  must 
evaluate  the  function  at  these  two  extremes.  Hall  (2002)  explains  that  vertical 
arrangements  are  designed  for  centralization  of  authority  and  direct  control  typical  of  the 
large  manufacturing  organizations  of  the  past.  Problems  with  vertical  structure  include 
slow  communication  through  the  levels  of  hierarchy,  restricted  decision  making,  and 
possible  detachment  between  top  management  and  operations.  He  continues  stating  that 
horizontal  arrangements,  in  contrast,  emphasize  a  decentralization  of  authority  and 
control  enabling  increased  communication  and  flexibility  within  the  organization.  The 
trend  of  many  organizations  today  is  toward  the  horizontal  type  structure. 

Functional  Structure.  Functional  structure  exists  when  common  activities  are 
grouped  into  departments,  areas,  or  units  (Hall,  2002).  The  emphasis  of  functionally 
organized  firms  is  to  increase  efficiency  by  combining  skills  and  capitalizing  on  expertise 
and  experience.  An  in-depth  knowledge  base  is  maintained  through  a  certain  level  of 
specialization  gained  by  an  association  of  similarly  related  skills.  Figure  4  depicts  the 
common  organizational  elements  found  in  a  functional  type  structure. 
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Figure  4.  Example  of  Funetional  Strueture 

Product/Serviee  Strueture.  A  structure  built  around  products  or  services  occurs 
when  the  activity  of  the  company  is  determined  by  the  different  types  of  supplied 
products  and  services  (Hall,  2002).  Within  this  format,  product  groups  are  formed  by 
incorporating  members  possessing  each  of  the  necessary  skill  sets  required  to  produce  a 
product  or  provide  a  service.  For  each  additional  product  or  service,  a  new  product  group 
must  be  formed  with  the  attributes  required  for  that  specific  product  or  service. 


Figure  5.  Example  of  Product/Service  Structure 
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In  distinguishing  between  functional  or  product/service  oriented  structures,  again 
one  must  associate  the  resources  and  goals  of  the  organization  with  the  attributes  of  each 
structure.  Hall  (2002)  describes  that  functional  structures  obtain  efficiency  through 
consolidating  resources  and  specialization.  The  downfall  to  this  format  is  a  stove-piping 
of  skills  and  narrowed  view  of  organizational  objectives.  Product/Service  oriented 
structures  essentially  reverse  these  issues  by  requiring  members  to  possess  a  wide 
knowledge  base  of  required  skills  and  overall  goals  of  the  entire  organization.  However, 
it  does  lose  the  efficiency  of  functional  association  through  the  increased  number  of 
independently  operational  departments. 

Organizations  may  operate  best  anywhere  in  between  the  extremes  previously 
described  or  through  any  combination  thereof.  In  today's  rapidly  changing  global 
environment,  the  aspects  of  organizational  objectives,  technology,  and  availability  of 
resources  must  be  evaluated  in  determining  an  effective  organizational  structure.  Finding 
the  proper  balance  point  between  vertical  and  horizontal  structure,  and  building  toward  a 
functional  or  product/  service  orientation  is  an  ever-changing  process. 

Air  Force  Structures 

The  Air  Force's  organizational  structure  has  undergone  many  changes  throughout 
its  history  in  an  effort  to  maximize  its  own  performance  and  efficiency.  In  an  effort  to 
provide  guidance  in  establishing  Air  Force  structure.  Air  Force  Instruction  (AFI)  38-101, 
Manpower  and  Organization,  outlines  the  following  management  principles:  "Emphasis 
on  wartime  tasks.  Functional  grouping.  Lean  organizations.  Skip-echelon  structure,  and 
Standard  levels"  (Department,  2003:5). 


12 


From  these  prineiples  Air  Foree  organizations  are  directed  to  establish  common 
structures  capable  of  accomplishing  wartime  tasks  with  minimal  resources  at  maximum 
efficiency.  The  parts  are  to  work  closely  together  toward  the  primary  mission  without 
requiring  unnecessary  intermediate  levels  of  management.  "Factors  such  as  scope  of 
responsibility,  span  of  control  and  functional  grouping  of  related  missions/activities  are 
the  predominant  factors  that  determine  organizational  kind."  (Department,  2003:5). 

Prior  to  October  2002,  the  last  formal  change  to  Air  Force  organizational  structure 
occurred  in  1992.  At  the  end  of  the  Cold  War  in  the  late  1980's,  the  Air  Force  and  other 
services  were  directed  to  begin  a  25  percent  reduction  in  force  structure  (Deptula,  2001). 
This  caused  the  Air  Force  to  make  fundamental  changes  to  its  organizational  composition 
which  resulted  in  what  is  known  as  the  "Objective  Wing  Structure".  Under  the  objective 
wing  structure,  four  groups  were  formed  to  perform  the  major  functions  of  the 
operational  wing  as  shown  in  Figure  6. 
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WING 

COMMANDER 


Figure  6.  Objective  Wing  Structure  (AFI  38-101,  Fig  3.5) 


Aircraft  maintenance  organizations  were  divided  and  aligned  under  both  the 
Operations  Group  and  the  Logistics  Group  depending  on  MAJCOM  and  primary  mission. 
Standard  fighter  wings  under  Air  Combat  Command  (ACC)  sought  to  align  all  on- 
equipment  aircraft  maintenance  within  the  Operations  Group.  Maintenance  resources 
and  those  functions  directly  related  to  sortie  generation  were  under  the  control  of  an 
Operations  Squadron  Commander  as  depicted  in  Figure  7.  Major  maintenance  and  off- 
equipment  aircraft  maintenance  functions  remained  under  the  Logistics  Group  as 
previously  depicted. 
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SQUADRON 

COMMANDER 


Figure  7.  Operations  Squadron  Strueture  (AFI  38-101,  Fig  3.11) 


Strategic  Airlift  and  Refueling  units  within  Air  Mobility  Command  (AMC) 
aligned  all  on-  and  off-equipment  aircraft  maintenance  functions  under  the  Logistics 
Group  with  the  incorporation  of  the  Aircraft  Generation  Squadron.  This  was  done  with 
the  intent  to  match  functions  more  closely  to  mission  requirements. 

The  goals  of  the  objective  wing  stmcture  were  to  decentralize  authority,  remove 
unnecessary  layers,  and  give  field  commanders  responsibility  for  all  elements  necessary 
for  mission  accomplishment  (Gray  &  Ranalli,  1992).  The  objective  wing  was  designed 
to  align  personnel  around  a  specific  "manufacturing  division",  the  operational  flying 
squadron,  and  a  specific  product,  sorties.  The  Operations  Group  was  responsible  for  the 
entire  sortie  producing  effort.  The  Logistics  Group  performed  all  major  and  off- 
equipment  aircraft  maintenance  and  other  supporting  logistical  functions. 
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During  the  1990's,  the  Air  Foree  eontinued  to  recognize  the  need  to  adapt  to  the 
changing  global  environment  (Deptula,  2001).  Corrective  actions  were  required  in 
response  to  the  difficulties  encountered  in  the  Persian  Gulf  War  propelling  initiatives  that 
required  new  ways  of  operating.  The  emergence  of  the  Aerospace  Expeditionary  Force 
concept  in  the  mid-1990's  intended  to  further  decentralize  authority  and  provide  the 
flexibility  needed  to  fight  the  battles  of  the  new  century. 

Following  the  Chief  of  Staff  Fogistics  Review  (CFR)  of  2001,  General  Jumper 
directed  all  aircraft  wings  to  organize  under  a  universal  format  known  as  the  "Combat 
Wing  Structure"  depicted  in  Figure  8. 


Medical  Support 
Squadron 


Medical  Operations 
Squadron 


Figure  8.  Combat  Wing  Structure  (PAD  02-05,  Appendix  I  to  Annex  A) 
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The  major  changes  under  the  new  combat  wing  structure  were  intended  to  focus 
on  core  competencies  within  each  group  (Chapman,  2002).  The  Medical  Group  saw  little 
in  the  way  of  changes  under  this  reorganization.  The  previously  titled  Support  Group 
witnessed  the  incorporation  of  three  new  squadrons  and  was  renamed  the  Mission 
Support  Group  (MSG).  Standard  logistics  functions  of  supply  and  transportation  were 
merged  forming  the  new  Logistics  Readiness  Squadron  and  were  transferred  to  the  MSG 
from  the  old  Logistics  Group.  Additionally,  the  entire  Contracting  Squadron  and  Aerial 
Port  Squadron,  at  those  locations  possessing  one,  were  also  realigned  under  the  MSG. 
With  the  sole  mission  of  providing  all  aspects  of  aircraft  maintenance,  the  Logistics 
Group  is  now  called  the  Maintenance  Group  (MXG).  The  Operations  Group  was 
relieved  of  all  maintenance  related  resources  and  functions  which  were  returned  to  the 
MXG. 

The  intent  of  this  structure  was  to  standardize  operations  across  the  Air  Force  and 
enhance  its  expeditionary  capabilities  (Chapman,  2002).  The  vision  projected  by  the 
CSAF,  General  John  Jumper,  was  to  allow  each  group  to  focus  on  the  essential  core 
competencies  and  re-instill  a  focus  on  maintenance  policy,  procedures,  training, 
discipline,  and  enforcement.  He  sought  to  obtain  improvements  in  sortie  production  and 
fleet  health  for  aircraft  maintenance  organizations  as  called  for  by  inputs  to  the  CLR 
(Zettler,  2001).  For  the  personnel  of  the  organizations,  members  would  be  able  to  gain 
mentorship  from  everyone  in  the  chain  of  command  from  the  group  commander  down. 
Aircraft  Maintenance  Performance  Measurements 

When  measuring  performance,  it  is  critical  to  identify  and  use  the  appropriate 
metrics.  Research  exposed  that  no  one  measurement  of  sortie  production  or  fleet  health 
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exists  which  driving  the  search  for  key  maintenance  metrics.  There  were  three  resources 
used  when  defining  and  selecting  aircraft  maintenance  performance  measurements.  They 
include:  Air  Force  Instructions,  Monthly  Maintenance  Reports  and  MAJCOM  briefings, 
and  the  Air  Force  Chief  of  Staff  Logistics  Review. 

Air  Force  Instruction  2I-I0I,  Aerospace  Equipment  Maintenance  Management, 
describes  23  of  what  it  calls  "primary  maintenance  metrics"  (Department,  2001).  These 
metrics  include  both  leading  and  lagging  type  indicators  used  in  identifying  the  impact  of 
maintenance  capabilities  and  trends  in  maintenance  performance.  AFI  21-101  gives 
universal  guidance  to  all  aircraft  maintenance  organizations  throughout  the  Air  Force  as 
to  the  types  of  metrics  to  observe  and  how  to  calculate  the  measurements.  A 
comprehensive  list  of  these  terms  and  their  definitions  are  provided  in  Appendix  A. 

Maintenance  data  system  analysis  sections  are  each  required  to  prepare  and 
submit  unit  health  of  force  reports  and  representative  maintenance  data  to  headquarters  as 
outlined  in  MAJCOM  supplements  to  AFI  2I-I0I  (Department,  2001).  The  principle 
report  used  is  the  (M)9203,  Monthly  Logistics  Readiness  Indicators,  which  provides 
headquarters  units  information  on  the  designated  aircraft  maintenance  metrics.  The 
metrics  reported  include  the  following:  Mission  Capable  (MC)  Rate,  Total  Not  Mission 
Capable  Maintenance  (TNMCM)  Rate,  Total  Not  Mission  Capable  Supply  (TNMCS) 
Rate,  Cannibalization  Rate  (CR),  Home  Station  Logistics  Departure  Reliability  (HSLDR) 
Rate,  Logistics  Air  Abort  Rate  (AAR),  Break  Rate  (BR),  8/12  Hour  Lix  Rate  (LR), 
Delayed/Deferred  Discrepancy  (DD)  Rate,  and  Dropped  Objects  (DOP). 

Each  MAJCOM  also  conducts  regularly  scheduled  briefings,  typically  monthly, 
describing  the  performance  of  the  organizations  under  their  command.  The  following 
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metrics  were  found  to  be  present  in  at  least  one  of  the  multiple  MAJCOM  briefings: 
Awaiting  Maintenance  (AWM),  Awaiting  Parts  (AWP),  Repeat/Recur  Discrepancy  Rate 
(R/R),  Average  Possessed  Aircraft  (APA),  Hourly  Use,  World-wide  Logistics  Departure 
Reliability  (WW  LDR),  Enroute  LDR,  Flying  Schedule  Effectiveness  (FSE),  Scheduling 
Deviations,  Maintenance/Operations  Deviations  (DEV),  and  Maintenance  Scheduling 
Effectiveness  (MSB),  in  addition  to  all  those  provided  in  the  (M)9203  report. 

Finally,  the  Air  Force  Chief  of  Staff  Eogistics  Review  that  prompted  the  changes 
to  organizational  structure  identified  three  categories  of  performance  indicators  (Zettler, 
2001).  The  first  category  was  "Overall  Balance  Indicators,"  which  included  Flying  Hour 
Program  (FHP),  Utilization  Rate  (UTE),  DEV  Rate,  MSB,  and  FSE.  The  second 
category  was  "Sortie  Production  Indicators,"  including  Abort  Rate  (AR),  8-hour  FR,  BR, 
Repeat  (RP)  Rate,  Recur  (RC)  Rate,  Mission  Capable  Parts  (MICAP)  Rate,  and  CR.  The 
final  category  was  "Fleet  Health  Performance  Indicators,"  which  include  TNMCM, 
Average  Repair  Cycle  Processing  Time  (RCP),  DD,  R/R  Rate,  Time  Compliance 
Technical  Order  (TCTO)  Backlog,  Phase  Flow  Days  (PF),  and  Phase  Time  Distribution 
Interval  (TDI). 

Once  metrics  are  identified,  the  next  step  involves  collecting  the  data.  Obtaining 
accurate  and  unbiased  information  is  critical  to  performing  proper  analysis  in  an  effort  to 
identify  organizational  performance.  Analysis  sections  rely  upon  data  retrieved  from 
various  maintenance  information  systems  for  generating  information.  AFI  21-101 
(Department,  2001)  identifies  the  following  primary  data  sources:  Core  Automated 
Maintenance  System  (CAMS)/Integrated  Maintenance  Data  System  (IMDS),  G081 
(CAMS  for  Mobility),  Reliability  and  Maintainability  Information  System  (REMIS), 
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Standard  Base  Supply  System  (SBSS),  Air  Foree  Knowledge  System  (AFKS),  and 
AF/IL-approved  eommand-unique  analysis  tools. 

Previous  Research 

Since  1980,  nine  other  research  projects  were  identified  relating  to  aircraft 
maintenance  performance  with  respect  to  organizational  structure,  the  last  of  which 
occurred  in  2001  prior  to  the  latest  reorganization.  Seven  of  the  nine  projects  used  a  form 
of  means  comparison  and  regression  analysis.  The  remaining  two  research  projects  used 
a  method  known  as  "Constrained  Facet  Analysis",  which  was  deemed  inappropriate  for 
further  use,  and  thus  excluded  them  from  use  in  this  research.  More  important  than  the 
results  of  these  projects  are  the  metrics  used,  the  shortcomings  identified,  and  the  critical 
elements  recognized  as  being  necessary  in  performing  meaningful  analysis.  An  overall 
data  table  of  the  seven  researchers  and  the  metrics  each  used  is  provided  in  Appendix  B. 

Diener  and  Hood  (1980)  performed  an  analysis  of  organization  and  its  effects  on 
sortie  generation  capability  and  maintenance  quality.  Their  sample  included  aircraft  from 
six  active  duty  fighter  squadrons.  They  utilized  10  months  of  data  from  which  they  chose 
six  independent  and  nine  dependent  variables.  Their  analysis  techniques  included 
stepwise  regression,  Wilcox  signed  rank  test,  and  correlation  analysis.  The  overall  result 
of  their  analysis  showed  mixed  results  toward  the  influence  of  organization  on  sortie 
generation  and  maintenance  quality.  The  principle  result  influencing  future  research 
identified  that  maintenance  data  can  not  be  assumed  to  be  normally  distributed  and  may 
require  the  use  of  non-parametric  statistical  methods. 

Gilliland  (1990)  examined  the  relationships  of  measures  used  in  evaluating  a 
unif  s  performance.  He  obtained  data  from  six  mobility  wings  over  a  6-month  interval. 
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He  chose  five  independent  and  eight  dependent  variables  and  used  stepwise  regression, 
correlation  analysis,  and  residual  analysis.  Results  identified  four  variables  of  CR, 

AWM,  APA,  and  AWP  as  principle  components  which  could  be  used  in  modeling 
aircraft  performance.  The  impact  of  these  results  provided  a  model  using  interaction  and 
residual  analysis. 

Jung  (1991)  sought  to  further  the  research  performed  by  Gilliland  using  nine 
different  aircraft  from  Strategic  Air  Command  over  a  21 -month  period.  He  used  similar 
analysis  techniques  of  stepwise  regression,  correlation  analysis,  and  residual  analysis  in 
evaluating  23  independent  and  three  dependent  variables.  The  results  of  this  analysis 
directed  that  an  aggregate  model  of  multiple  aircraft  types  yielded  inconsistent  and 
inconclusive  results. 

Davis  and  Walker  (1992)  attempted  to  make  a  comparison  of  aircraft  performance 
across  services  by  comparing  two  Air  Force  aircraft  (F-15  &  F-16)  with  two  Navy 
aircraft  (F-14&F-18).  Pre-objective  wing  data  was  gathered  for  Air  Force  aircraft  while 
data  from  Navy  aircraft  represented  performance  under  an  objective  wing  structure.  This 
was  due  to  the  lack  of  objective  wing  data  within  the  Air  Force  at  the  time.  Analysis 
techniques  of  stepwise  regression  and  a  paired  T-test  were  used  along  with  a  split-half 
technique.  Only  four  independent  variables  and  one  dependent  variable  were  used. 
Results  were  ineffective  at  providing  meaningful  analysis  between  the  two  samples  due 
to  inconsistencies  in  variables  and  measuring  techniques. 

Gray  and  Ranalli  (1993)  sought  to  determine  the  impact  of  the  major  Air  Force 
reorganization  that  took  place  in  1992.  Similar  techniques  from  past  research  of  stepwise 
regression,  correlational,  and  residual  analysis  were  utilized.  They  selected  two  aircraft 
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types  (B-52  &  KC-135)  from  one  Air  Foree  base  and  ehose  nine  independent  and  two 
dependent  variables  for  their  analysis.  A  eolleetion  eneompassing  37  months  of  B-52 
aireraft  data  and  28  months  of  KC-135  aireraft  data  was  obtained  from  monthly 
maintenanee  summaries.  Results  determined  that  there  was  a  signifieant  improvement  in 
the  dependent  and  some  independent  variables,  representing  improved  performanee  under 
the  new  strueture. 

Stetz  (1999)  attempted  to  deteet  the  impaet  of  similar  organizational  strueture 
ehanges  on  a  speeifie  aircraft  maintenance  organization.  His  intent  was  to  determine  the 
existence  of  improvements  in  productivity  under  the  new  structure.  Data  were  collected 
and  analyzed  covering  24  months  of  pre-  and  24  months  of  post-organizational  structure. 
The  sample  selection  included  only  one  airframe  (E-3)  and  one  organizational  unit  (552 
ACW).  Using  the  established  techniques  of  stepwise  regression  and  a  T-test  comparison, 
he  tested  a  total  of  21  variables  chosen  by  common  use  at  the  552  ACW  and  use  in  past 
research.  Results  of  the  analysis  proved  effective  in  determining  a  minimal  impact  as  a 
result  of  the  organizational  change. 

Commenator  (2001)  expanded  the  previous  work  in  evaluating  the  effects  of  the 
objective  wing  structure  and  aircraft  maintenance  performance.  Again  using  stepwise 
regression  and  comparison  of  means,  he  identified  10  variables  (nine  moderating  factors 
and  organizational  structure)  for  use  in  his  model.  Results  of  this  particular  analysis  were 
mixed,  finding  that  a  significant  positive  influence  was  made  on  at  least  one  aircraft 
maintenance  performance  measure  for  five  of  the  six  units  tested. 
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Summary 

This  chapter  outlined  the  basis  of  organizational  theory  and  the  domain  in  whieh 
organizational  strueture  is  built.  It  deseribed  the  vertical  and  horizontal  methods  of 
hierarehy  and  control  and  also  the  funetional  and  product/service  orientation  that  may  be 
followed.  It  then  identified  the  struetural  basis  of  Air  Foree  organizations,  past  and 
present,  in  an  effort  to  show  the  contrast  between  the  two.  This  was  followed  by 
comprehensive  descriptions  of  the  aireraft  maintenance  performance  measures  direeted 
and  used  by  Air  Foree  leadership.  The  chapter  ended  with  a  listing  of  the  methods  used 
and  key  results  obtained  by  previous  researehers  on  assoeiated  topies. 
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Ill,  Methodology 

Purpose  Statement 

The  purpose  of  this  researeh  was  to  determine  the  effectiveness  of  the  newly 
implemented  combat  wing  structure,  as  measured  by  aircraft  maintenance  performance. 
The  study  proposes  to  accomplish  this  by  first  identifying  the  research  model  used  for  the 
analysis.  Next,  it  identifies  the  population/sample  used  in  conducting  the  research  along 
with  the  aircraft  maintenance  metrics  selected  for  assessment.  This  was  followed  by 
identifying  sources  used  for  obtaining  the  previously  mentioned  maintenance  metrics  and 
the  time  interval  over  which  the  data  were  collected.  Finally,  it  describes  the  statistical 
analysis  methods  used  in  an  attempt  to  detect  significant  differences  between  pre-  and 
post-structural  change  maintenance  data. 

Research  Paradigm 

This  research  used  techniques  both  quantitative  and  qualitative  in  nature.  A 
comprehensive  review  of  the  literature  set  the  basis  for  organizational  structure  and 
change  theory,  both  external  and  internal  to  the  Air  Force.  It  also  built  a  framework  of 
important  factors  used  in  measuring  aircraft  maintenance  performance.  This  drove  the 
types  of  data  to  collect  and  the  methods  of  analyzing  the  data  from  both  pre-  and  post¬ 
implementation  phases  of  the  recent  Air  Force  organizational  change.  Quantitative 
analysis  tools  were  used  to  measure  and  compare  the  performance  of  aircraft  maintenance 
organizations.  The  data  collected  for  this  study  dictated  the  specific  statistical  methods 
used  during  this  portion  of  the  research.  Then,  the  results  were  categorized  and 
quantified  for  use  in  determining  the  overall  results.  An  evaluation  of  the  analysis  was 
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conducted  throughout  to  determine  the  existence  of  any  eonfounding  variables  suspect  in 
the  researeh. 

Theoretical  Model 

The  theory  of  this  researeh  is  that  the  combat  wing  structure  has  been  effective  at 
meeting  its  intended  objeetives  of  improving  aireraft  maintenance  performanee.  This 
researeh  focuses  speeifically  on  the  areas  of  overall  balanee,  sortie  production  and  fleet 
health.  In  evaluating  this  theory,  an  array  of  maintenance  metrics  were  collected  and 
analyzed  using  multiple  statistical  analysis  methods.  The  tests  that  were  conducted 
inelude  the  following;  normality  of  the  sample  distribution,  homogeneity  of  variance, 
means  comparison,  weighted  factoring,  and  trend  analysis.  The  first  three  tests  were  used 
to  determine  data  eharacteristics  and  if  statistieally  significant  differences  exist  between 
pre-  and  post-organizational  ehange  data.  The  direction  of  any  noted  changes  were  then 
classified  and  quantified  using  weighted  faetor  analysis.  Finally,  trend  analysis  was  used 
to  supplement  the  previous  findings  and  aid  in  determining  the  overall  conelusions. 
Population  and  Sample  Selection 

The  population  for  this  study  is  U.S.  Air  Force  aireraft  maintenanee  organizations 
organized  under  the  eombat  wing  structure.  Sinee  the  reorganization  in  2002,  this 
population  includes  units  from  all  MAJCOMs  throughout  the  Air  Force.  The  sample 
used  for  this  study  includes  aircraft  maintenance  organizations  from  both  Air  Combat 
Command  (ACC)  and  Air  Mobility  Command  (AMC).  These  commands  were  selected 
based  on  their  steadfast  operational  mission  and  structural  impact  of  the  reorganization. 
As  shown  in  the  literature  review,  ACC  underwent  signifieant  organizational  ehanges 
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during  the  reorganization  while  AMC  felt  less  of  an  impaet.  This  allows  for  not  only  a 
eomparison  within  eaeh  eommand,  but  also  a  eomparison  aeross  eommands. 

The  aircraft  chosen  was  limited  to  one  mission  design  series  (MDS)  from  each 
MAJCOM.  Representing  ACC  is  the  F-16  Fighting  Falcon  which  has  been  in  operation 
since  1979.  The  F-16  is  a  core  component  of  the  Air  Combat  Command.  Representing 
AMC  is  the  KC-135  Strato-tanker.  It  has  a  long  history  with  the  AMC  dating  back  to 
1957  and  has  remained  a  staple  throughout  the  decades.  Both  aircraft,  as  with  the 
commands  they  represent,  have  had  a  continuous  mission  over  time.  Three  operational 
units  of  each  MDS  were  selected  for  comparison.  The  similarities  between  them 
included:  mission,  organizational  size  and  structure,  aircraft  type,  and  operations  tempo. 
Additionally,  these  units  were  found  to  be  commonly  compared  to  one  another  in 
command  level  briefings.  F-16  units  from  the  20FW,  Shaw  AFB,  the  388FW,  Hill  AFB, 
and  the  27FW,  Cannon  AFB  were  chosen  as  well  as  KC-135  units  from  the  22ARW, 
McConnell  AFB,  the  92  ARW,  Fairchild  AFB,  and  the  319ARW,  Grand  Forks  AFB. 
Variable  Selection 

The  literature  review  identified  the  objectives  of  the  reorganization  as  enhancing 
the  areas  of  sortie  production  and  improving  fleet  health.  For  this  reason,  measurement 
of  these  two  elements  was  the  main  focus  during  variable  selection.  Also  discovered  in 
the  literature  review,  there  are  no  direct  measurements  of  either  sortie  production  or  fleet 
health  available.  To  aid  in  variable  selection,  commonalities  and  discords  between 
aircraft  maintenance  metrics  recognized  in  Air  Force  Instructions,  MAJCOM  reports  and 
briefings,  and  the  CLR  were  identified.  A  table  of  the  data  sources  and  the  aircraft 
maintenance  metrics  each  recognizes  was  constructed  and  is  presented  in  Appendix  C. 
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It  is  important  to  note  that  four  of  the  variables  are  identified  in  the  Air  Force 
Instruction  as  key  metrics,  yet  are  not  recognized  by  the  other  sources.  They  include: 


Hangar  Queen  (HQ),  Primary  Aerospace  Vehicle  Authorized  vs.  Possessed  (P/P), 
Personnel  Assigned  (PA),  and  Upgrade  Training  (UT).  Additionally,  the  two  variables  of 
AWM  and  AWP  are  only  noted  in  MAJCOM  Briefings.  Most  importantly,  four  variables 
are  presented  in  the  CLR  which  drove  the  reorganization,  but  are  not  acknowledged  in 
any  of  the  other  sources.  The  variables  noted  are  FHP,  MICAP,  TCTO  Backlog,  and 
TDI. 

When  selecting  aircraft  maintenance  metrics  to  be  used  in  the  comparative 
analysis,  a  compilation  of  the  sources  described  in  Chapter  2  was  used.  Primary 
consideration  was  given  to  the  factors  described  within  the  CLR  and  supplemented  with 
metrics  from  the  other  sources.  Figure  9  depicts  the  final  variable  selection  and 
arrangement  in  relation  to  their  measurement  objective. 
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Figure  9.  Research  Variables 


First  depicted  are  Overall  Balance  Indicators.  The  DEV  Rate  used  included  only 
those  deviations  accountable  to  maintenance  and  operations,  excluding  all  others  such  as 
weather,  air  traffic  control,  etc.  This  was  done  in  an  effort  to  only  account  for  those 
actions  affected  by  aircraft  operations.  The  FHP  outlined  in  the  CLR  was  represented  by 
the  metrics  of  Actual  Flying  Hours  (FHA)  and  Actual  Sorties  Flown  (FSA).  FSE  and 
MSE  represented  measurements  of  planning  capabilities  and  were  used  where  data  were 
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available.  UTE  Rate  ineluded  both  the  aetual  Hourly  Utilization  (HUTE)  Rate  as  well  as 
aetual  Sortie  Utilization  (SUTE)  Rate. 

Next  were  Sortie  Produetion  Indicators  which  reflected  all  but  one  of  the  CER 
metrics,  MICAP,  which  was  inaccessible.  The  six  remaining  metrics  of  8-Hour  PR,  AR, 
BR,  CR,  RC,  and  RP  Rate  were  all  included  in  the  research.  The  AR  metric  used  was  a 
combined  total  abort  rate  as  opposed  to  separate  air  and  ground  aborts. 

Third  were  Elect  Health  Performance  Indicators  which  were  altered  slightly  from 
the  CER.  PE  Days,  TDI,  and  TCTO  Backlog  were  eliminated  for  their  specific  airframe 
applicability  and  inaccessibility.  Included  in  the  analysis  were  DD,  R/R,  and  TNMCM. 
Average  RCP  Time  information  was  only  available  and  analyzed  for  the  P-16  airframe. 
To  supplement  this  section,  the  additional  variables  of  Average  Possessed  Aircraft 
(APA),  Maintenance  Man-hours/Plying  Hour  (MMH),  and  MC  Rate  were  incorporated. 
Data  Collection 

Actual  data  used  for  analysis  were  collected  with  assistance  from  the  MAJCOM 
Analysis  departments  of  ACC/EGP  and  AMC/A44QA,  the  Information  Systems 
department  of  MSG/MAR,  and  individual  analysis  sections  from  each  of  the  selected 
units.  The  primary  sources  for  retrieval  included  electronic  maintenance  data  collection 
systems  of  CAMS,  G081,  and  REMIS  as  described  in  Chapter  2.  The  data  contained  in 
these  systems  is  known  to  be  the  most  accurate  (approximately  95%)  and  comprehensive 
source  of  aircraft  maintenance  performance  measurements.  Undeniably,  these  systems 
are  also  the  sole  source  used  by  organizational  leaders  when  reviewing  maintenance 
performance  on  a  routine  basis.  Comprehensive  tables  of  maintenance  data  representing 
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each  of  the  sample  units  are  presented  in  Appendix  D.  Additionally,  time  series  plots  of 
the  collected  data  are  provided  in  Appendix  J. 

Time  Interval 

The  time  interval  covered  when  collecting  data  extended  over  a  five  year  period 
surrounding  the  effective  date  of  the  reorganization.  In  an  effort  to  reduce  possible 
skewing  of  the  results,  only  four  years  of  data  were  used  in  the  analysis.  The  most  recent 
two  year  period  since  the  reorganization,  which  included  the  24  months  from  October 
2002  to  September  2004,  was  used  to  represent  the  performance  under  the  current  combat 
wing  structure.  The  year  immediately  preceding  the  reorganization  was  greatly  impacted 
by  contingency  operations  conducted  in  response  to  the  September  11,  2001  terrorist 
attacks.  For  this  reason,  data  during  the  September  2001  through  September  2002  time 
period  were  excluded  from  the  analysis.  Pre-implementation  data  was  gathered  for  a 
comparable  24  month  period  beginning  September  1999  and  ending  August  2001.  Table 
1  illustrates  the  time  interval  described  above. 


Table  1.  Time  Interval 


Analysis  Time  Interval 

Pre-reorganization 

Excluded 

Post-reorganization 

Sep  99  -  Aug  01 

Sep  01  -  Sep  02 

Oct  02  -  Sep  04 

Statistical  Tools 

The  primary  statistical  tool  used  in  conducting  this  research  was  the  IMP® 
Version  5.1  (IMP  5.1)  statistical  analysis  software  package.  IMP  5.1  provides  a  means  to 
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"dynamically  link  statistics  with  graphics  to  interactively  explore,  understand,  and 
visualize  data"  (JMP  5.1,  2004). 

Analysis  Methods 

From  the  results  of  past  researeh  and  guidanee  from  statistieal  experts,  tests  for 
normality  and  equal  varianee  of  the  sample  data  were  eonducted  first.  Eaeh  of  these  tests 
was  performed  to  identify  the  basie  data  eharaeteristies  of  the  sampling  distribution.  This 
must  be  aceomplished  in  an  effort  to  overeome  some  of  the  basic  assumptions  of 
statistical  testing  and  make  relative  eomparisons  of  like  items.  In  the  event  that 
differenees  exist  in  sampling  distributions  or  varianee  tests  prove  to  not  be  equal,  the 
statistieal  methods  used  for  eomparison  must  be  expanded  from  a  simple  to  a  more 
eomplex  form. 

To  begin  the  analysis,  a  significanee  level  of  0.05  was  selected  for  all  hypotheses 
testing  in  an  effort  to  reduee  the  number  of  Type  I  errors.  These  errors  oeeur  when  the 
null  hypothesis  is  rejected  as  true,  when  in  faet  the  null  hypothesis  is  true  (MeClave  and 
others,  2001:340-344).  A  large  level  of  signifioanee  allows  for  most  of  an  entire 
population  to  fall  within  the  rejeetion  region  and  the  null  would  be  rejected.  A  small 
level  of  signifioanee  enables  aooeptanoe  of  the  alternate  hypothesis  with  very  little  of  the 
population  falling  within  the  rejeetion  region. 

Normality  Tests.  Normality  tests  were  first  performed  to  overeome  the 
assumption  that  the  data  were  from  a  normal  distribution.  This  was  eonducted  using  a 
goodness  of  fit  test  known  as  the  Shapiro-Wilk  W  test  available  in  JMP  5.1.  This  type  of 
test  is  an  empirioal  distribution  function  test  whioh  is  proven  to  offer  advantages,  sueh  as 
improved  power,  over  typieal  Chi-square  tests  (JMP  5.1,  2004).  The  test  produces  a  W- 
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value  ranging  from  0.000000  to  0.999999  along  with  an  associated  probability,  or  p- 
value,  ranging  from  0.0000  to  0.9999.  The  Shapiro-Wilk  W  test  establishes  a  null 
hypothesis  that  the  data  are  from  a  normal  distribution,  based  on  standard  hypothesis 
testing.  Therefore,  if  the  p-value  produced  by  the  test  was  less  than  0.05,  the  null 
hypothesis  was  rejected  and  the  data  considered  non-normal. 

Variance  Tests.  Tests  of  variance  were  conducted  in  two  phases  in  order  to 
identify  homogeneity  and  determine  change  characteristics  of  sample  data.  Five  types  of 
variance  tests  were  available  for  evaluation  purposes.  They  included  the  O'Brien, 
Brown-Forsyth,  Levene,  Bartlett,  and  2-sided  F-test.  Each  of  them  produces  an  F-ratio 
accurate  to  four  decimal  places  and  an  associated  p-value  ranging  from  0.0000  to  0.9999. 
As  with  the  test  for  normality,  a  p-value  less  than  0.05  will  reject  the  null  hypothesis  that 
the  data  has  equal  variances  and  consider  them  unequal.  By  definition,  the  Levene  test 
does  not  make  any  assumption  of  data  normality,  nor  is  it  limited  to  the  number  of  groups 
tested  as  is  the  case  with  some  of  the  other  tests  (JMP  5.1,  2004).  For  these  reasons  the 
Levene  method  was  the  only  test  of  equal  variance  selected  for  use  in  this  research. 

Comparison  of  Means  Tests.  Comparison  of  sample  means  tests  were  the  primary 
method  used  in  detecting  whether  or  not  significant  differences  exist  between 
measurements  of  sample  data  from  pre-  and  post-organizational  structure  change. 

Similar  to  the  variance  tests,  the  mean  values  were  first  tested  for  changes  in  data  sets 
followed  by  identification  of  the  direction  of  any  changes.  There  were  three  types  of 
means  comparisons  tests  used  in  the  analysis,  each  of  which  was  selected  based  on  the 
results  of  the  normality  and  variance  tests  previously  conducted.  Lor  the  data  reflecting 
normality  and  equal  variance,  a  simple  analysis  of  variance  (ANOVA)  L-test  was 
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performed.  Data  portraying  normality,  but  unequal  varianee  was  eompared  using  the 
Weleh  ANOVA  F-test.  Finally,  any  data  identified  to  be  from  a  non-normal  distribution 
was  tested  using  the  non-parametrie  Wileoxon  /  Kruskal-Wallis  (Rank  Sum)  tests.  For 
both  the  ANOVA  F-test  and  Weleh  ANOVA  F-test,  a  respeetive  F-ratio  and  p-value  was 
produeed,  as  with  the  varianee  tests.  Under  the  Wileoxon  /  Kruskal-Wallis  (Rank  Sum) 
tests,  the  F-ratio  was  exeluded  and  replaeed  with  a  Chi-square  value.  For  all  three  means 
eomparison  tests  deseribed,  the  null  hypothesis  was  that  the  mean  values  of  the  measures 
were  equal.  P-values  produeed  that  were  less  than  the  selected  0.05  level  of  significance 
rejected  the  null  hypothesis  and  the  means  were  considered  different. 

Separate  comparisons  were  made  for  each  of  the  selected  variables  identified  in 
Figure  9  for  both  the  F-16  and  KC-135  aircraft  maintenance  units.  Those  characterized 
as  having  unequal  variance  or  different  mean  values  between  pre-  and  post-combat  wing 
implementation  were  then  further  analyzed  for  direction  of  change.  Depending  on  the 
specific  variable,  either  an  increase  or  decrease  in  mean  value  was  recognized  as 
desirable,  as  presented  in  Table  2.  Alternatively,  an  overall  reduction  in  variance  was 
preferred  regardless  of  the  individual  variable. 


Table  2.  Desired  Direction  of  Change  in  Mean  Value 


1  Desired  Direction  of  Change  in  Mean  Value  | 

Variables 

Desired 

Result 

Variables 

Desired 

Result 

Variables 

Desired  Result 

0  B 

V  a 

e  1 

r  a 

a  n 

1  c 

1  e 

DEV 

T 

■ 

FR 

▲ 

1 

APA 

▲ 

FHA 

▲ 

AR 

T 

DD 

T 

FSA 

▲ 

BR 

T 

R/R 

T 

FSE 

▲ 

CR 

T 

T 

MSE 

▲ 

RC 

T 

T 

▲ 

T 

T 

▲ 

▲ 
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Identified  changes  to  the  maintenance  variables  were  then  plotted  in  one  of  nine 
categories  for  each  of  the  aircraft  units.  The  categories  include:  improved  mean  and 
improved  variance  (+M,  +V),  improved  mean  and  equal  variance  (+M,  =V),  equal  mean 
and  improved  variance  (=M,  +V),  improved  mean  and  degraded  variance  (+M,  -V),  equal 
mean  and  equal  variance  (=M,  =V),  degraded  mean  and  improved  variance  (-M,  +V), 
equal  mean  and  degraded  variance  (=M,  -V),  degraded  mean  and  equal  variance  (-M, 

=V),  and  finally  degraded  mean  and  degraded  variance  (-M,  -V).  Through  this  method,  a 
visualization  of  patterns  in  the  data  was  observed  across  the  airframe  as  a  whole.  To 
quantify  this  data,  a  numerical  value  of  positive  one  (+1)  was  assigned  for  each 
respective  change  category  the  variable  occupied.  Next,  category  totals  were  obtained  for 
each  variable  type  (overall  balance,  sortie  production,  and  fleet  health)  by  type  aircraft 
and  a  composite  total. 

Weighted  Factoring.  Further  determination  of  the  analysis  results  were  made 
through  weighted  factor  analysis.  This  was  accomplished  by  first  assigning  a  weight 
value  to  each  measurement  classification.  Both  mean  and  variance  were  weighted 
equally  in  this  analysis  based  on  the  similar  managerial  implications  of  improved  or 
degraded  performance  in  either  area.  Those  variables  with  no  detected  change  to  either 
mean  value  or  variance  were  assigned  an  overall  score  of  zero  (0)  establishing  the 
midpoint  of  the  weight  scale.  Next,  a  positive  one  (+1)  was  associated  with  the 
improvement  to  mean  value  or  variance  representing  a  desired  effect.  In  contrast,  those 
variables  with  degraded  mean  value  or  variance  were  assigned  a  negative  one  (-1) 
reflecting  an  undesirable  effect.  For  variables  having  equal  means  and/or  variances  for 
both  pre-  and  post-implementation  data,  a  zero  (0)  was  assigned  signifying  no 
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benefit/detriment  to  performance.  All  possible  weight  factor  combinations  were  then 
calculated  and  are  portrayed  in  Table  3. 


Table  3.  Weighted  Factor  Scale 


Weighted  Factor  Summary 

+M,+V 

+M,=V 

=M,+V 

+M,-V 

=M,=V 

-M,+V 

=M,-V 

-M,=V 

-M,-V 

+2 

+1 

+1 

0 

0 

0 

-1 

-1 

-2 

The  weighted  factor  was  then  multiplied  by  the  values  previously  obtained  in  each 
of  the  three  categories  of  overall  balance,  sortie  production,  and  fleet  health.  Values  were 
computed  for  each  individual  category  by  aircraft,  combined  category  total,  overall  total 
by  aircraft,  and  composite  totals.  These  values  were  then  used  in  evaluating  effectiveness 
of  aircraft  maintenance  under  the  combat  wing  structure. 

Trend  Analysis.  Trend  analysis  was  the  final  tool  used  in  making  the  overall 
determination  of  research  results.  Data  from  each  of  the  tested  variables  were 
investigated  for  trends  in  measured  value  both  prior  to  and  following  the  reorganization. 
Simple  linear  regression  techniques  were  performed  to  determine  the  slope,  or  trend,  of 
the  data  measurements  over  time.  The  regression  formula  for  this  portion  of  the  analysis 
and  its  parameters  are  described  below. 

Formula:  y  =  Po  +  Pix  +  £ 

where,  y  is  the  variable  being  measured 
X  is  time 

Po  is  the  intercept 
Pi  is  the  slope 
s  is  the  associated  error 
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Then,  these  trends  were  recognized  as  improving,  degrading,  or  remaining  the 
same  and  compared  between  pre-  and  post-implementation  periods.  This  was  done  using 
an  additional  regression  formula  and  the  same  0.05  percent  significance  level  to  detect 
differences.  This  model  uses  the  inclusion  of  a  dummy  variable  combined  with  standard 
hypothesis  testing.  The  formula  and  its  parameters  are  explained  below  along  with  the 
elements  of  the  hypothesis  test. 

Formula:  y  =  Po  +  Pix  +aiz  +  a2xz  +  s 

where,  y  is  the  variable  being  measured 
X  is  time 

z  is  a  dummy  variable 

z  =  0  for  pre-combat  wing 
z  =  1  for  post-combat  wing 
Po  is  the  intercept  for  z  =  0 
Pi  is  the  slope  for  z  =  0 
ai  is  the  difference  in  intercept  for  z  =  1 
02  is  the  difference  in  slope  for  z  =  1 
s  is  the  associated  error 

Therefore,  if  02  equals  0  both  lines  have  the  same  slope. 

Hypothesis:  Hq:  a2  =  0  vs.  Hi:  a2  ^  0 

Due  to  the  necessary  exclusion  of  the  last  year  of  pre-combat  wing  data, 
individual  observations  of  actual  data  plots  were  also  made  during  each  statistical  trend 
comparison.  An  additional  classification  of  "uncertain"  was  included  to  account  for  any 
instances  where  it  could  not  be  determined  whether  or  not  a  change  in  slope  was  a 
product  of  the  reorganization.  These  uncertainties  fit  into  only  one  of  two  possible 
scenarios.  First  were  those  trends  heading  in  an  improving  or  degrading  direction  and 
leveled  off  at  or  near  a  maximum/minimum  value  following  the  reorganization.  In  these 
instances,  it  was  assumed  that  the  trend  would  have  leveled  off  under  either  structure  and 
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any  noted  change  excluded  from  further  calculations.  Next  were  those  conditions  where 
the  ending  level  of  the  trend  from  the  pre-combat  wing  period  varied  greatly  from  the 
starting  level  of  the  trend  from  the  post-combat  wing  period.  In  this  situation,  if  the  trend 
appeared  to  be  returning  to  a  level  maintained  during  the  pre-combat  wing  period  the 
direction  was  determined  uncertain  and  the  change  information  also  excluded.  These 
results  were  again  categorized  and  quantified  by  variable  type  and  aircraft  unit.  Category 
and  overall  totals  were  then  used  to  further  evaluate  the  impact  of  organizational  structure 
on  aircraft  maintenance  performance. 

Confounding  Factors 

Due  to  the  nature  of  this  research,  there  are  numerous  confounding  factors  that 
could  undesirably  alter  the  analysis  results.  These  confounds  may  originate  internally 
during  the  methodology  of  the  research  or  externally  through  environmental  occurrences. 
When  performing  internal  tasks,  every  attempt  was  made  to  minimize  the  potential  for 
confounds  in  an  effort  to  provide  meaningful  results. 

The  first  confound  noted  is  population/sample  selection.  Each  of  the  sample  sub¬ 
populations  chosen  was  selected  based  on  similarities  in  unit  size,  resources,  airframe, 
and  mission.  Uncontrollable,  however,  were  other  factors  such  as  operating  environment, 
and  leadership  changes  which  were  considered  to  have  very  little  impact  on  results. 

Variable  selection  was  the  next  possible  confounding  factor.  The  variables 
themselves  could  prove  to  obscure  the  results  due  to  changes  in  meaning  and  methods  of 
calculation  over  time.  Each  of  the  variables  chosen  was  reviewed  for  changes  in  meaning 
and  formulation  from  the  initial  collection  date  until  the  final  month  of  this  study.  When 
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necessary,  raw  data  was  obtained  and  a  similar  formula  was  used  to  calculate  the  variable 
measurement. 

A  third  potential  confound  involves  the  methods  of  data  collection  used  and 
physical  data  entry.  The  possibility  exists  that  errors  may  have  occurred  in  data  retrieval 
commands  or  data  entry  at  the  point  of  origin  into  information  systems  through  final 
transfer  to  the  database  used  for  this  research.  Every  attempt  was  made  to  overcome 
these  errors  during  the  analysis  phase  of  the  research.  Similar  data  was  collected  using 
identical  systems  and  methods  for  uniformity  in  calculation  and  comparison. 

An  additional  confounding  factor  relates  to  the  time  over  which  the  analysis  was 
conducted.  As  mentioned  earlier,  steps  were  taken  to  eliminate  the  possible  skewing  of 
data  due  to  the  operations  surrounding  the  September  11,  2001  attacks.  However,  unable 
to  overcome  was  the  relationship  of  organizational  maturities  between  the  two  time 
periods.  Pre-combat  wing  data  was  collected  covering  the  8-  to  10-year  point  of  the 
organization's  structural  establishment.  Post-combat  wing  data  was  obtained  during  its 
infancy,  covering  the  first  two  years  of  existence.  This  factor  was  insurmountable  and 
was  considered  the  best  viable  option  in  conducting  this  research.  Obtaining  data  from 
earlier  in  the  pre-combat  wing  structure  would  have  been  increasingly  difficult  and 
undoubtedly  would  have  introduced  many  more  confounding  variables  into  the  analysis. 

The  final  confounding  factor  addressed  relates  to  the  external  events  that  occurred 
simultaneously  with  the  observation  period  of  this  research.  It  is  uncertain  if  changes  that 
took  place  within  the  logistics  functions  of  supply  and  transportation  influenced  any  of 
the  maintenance  operations.  These  areas  were  affected  similarly  to  aircraft  maintenance 
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and  work  to  support  their  primary  mission.  Additionally,  varying  defense  budgets  and 
the  programs  they  are  foeused  towards  may  have  unknowingly  influeneed  overall  results. 

Summary 

Chapter  3  outlined  the  methodology  used  in  eondueting  this  researeh.  It  ineluded 
the  researeh  paradigm  and  theoretieal  model  used  in  defining  this  researeh.  Additionally, 
the  population  and  sample  used  in  the  analysis  and  the  variables  seleeted  were  outlined 
along  with  the  sourees  of  data  and  time  interval  of  data  eolleetion.  The  statistieal  tool 
and  various  analytieal  methods  used  in  eondueting  the  analysis  were  also  deseribed  in 
detail.  Finally,  a  number  of  possible  eonfounding  faetors  surrounding  this  researeh  were 
presented. 
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IV.  Data  Analysis  and  Results 

Overview 

Chapter  4  presents  the  analysis  eondueted  and  results  obtained  while  researching 
the  effectiveness  of  aircraft  maintenance  under  the  combat  wing  structure.  The  analysis 
portion  was  divided  into  two  phases  in  an  effort  to  identify  whether  or  not  changes  to 
maintenance  performance  occurred  following  the  reorganization.  In  the  first  phase,  the 
characteristics  of  the  sampling  data  were  analyzed  for  those  F-16  and  KC-135  aircraft 
maintenance  metrics  outlined  in  Chapter  3.  Sampling  distributions  were  created  and 
tested  for  normality,  equality  of  variance,  and  comparison  of  means.  Variance  and  means 
comparison  test  results  were  further  analyzed  for  specific  effect  on  the  three  categories  of 
maintenance  metrics.  During  the  second  phase,  trend  analysis  was  performed  using 
simple  linear  regression  and  data  plotting.  These  results  were  similarly  characterized  and 
investigated  for  effected  changes  as  a  result  of  the  reorganization.  The  following 
paragraphs  present  a  systematic  compilation  of  the  testing  and  analysis  results. 

Analysis  Results 

The  results  of  the  analysis  will  contribute  to  determining  the  level  of  aircraft 
maintenance  performance  prior  to  and  following  the  Air  Force's  implementation  of  the 
combat  wing  structure.  They  will  first  demonstrate  whether  or  not  statistically  significant 
differences  exist  between  the  two  data  sets.  This  is  performed  in  an  effort  to  ascertain  the 
effectiveness  of  achieving  the  objectives  set  forth  for  aircraft  maintenance  organizations. 
Results  will  also  suggest  if  organizational  structure  was  a  major  factor  contributing  to  any 
observed  changes  in  performance  measurements.  Individual  results  of  the  previously 
described  tests  are  presented  in  the  following  paragraphs. 


40 


Normality  Tests 


Each  of  the  variables  from  the  six  aircraft  maintenance  organizations  was  tested 
for  normality  aeross  pre-  and  post- implementation  time  segments.  Of  the  110  possible 
groups  of  sample  variables,  58  were  identified  as  displaying  characteristics  representative 
of  a  normal  distribution.  The  remaining  52  sample  selections  were  eategorized  as  non¬ 
normal  distributions  and  direeted  any  further  analysis  to  follow  non-parametric  means. 
Separate  unit  and  individual  variable  results  are  explained  in  the  following  paragraphs. 
Detailed  analysis  results  representing  the  normality  tests  are  presented  in  Appendix  E. 

20EW.  As  a  result  of  testing  the  20  variables  from  the  20EW  for  normality,  9 
were  identified  as  being  normally  distributed  during  both  pre-  and  post-implementation. 
DEV,  SEA,  SUTE,  AR,  BR,  CR,  R/R,  TNMCM,  and  MC  all  had  p-values  which  justified 
aceepting  the  null  hypothesis  that  the  distributions  were  normal  for  both  segments  of 
data.  The  remaining  1 1  variables  rejected  the  null  hypothesis  in  either  pre-  or  post¬ 
implementation  portions  resulting  in  it  being  considered  from  a  non-normal  distribution. 
The  variables  ineluded  in  this  eategory  are:  EHA,  ESE,  MSE,  HEITE,  ER,  RC,  RP,  APA, 
DD,  RCP,  and  MMH.  Table  4  depicts  the  results  of  the  normality  test  for  the  20PW. 


Table  4.  20PW  Shapiro-Wilk  Normality  Test  Results 


20FW  Shapiro-Wilk  Normality  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

DEV 

X 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

X 

CR 

X 

RCP 

X 

MSE 

X 

RC 

X 

MMH 

X 

HUTE 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

X 
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27FW.  Data  from  the  27FW  presented  12  variables  eharaeterized  as  refleetive  of 


a  normal  distribution.  A  p-value  in  exeess  of  0.05  was  obtained  for  FHA,  SFA,  FSE, 
HUTE,  SUTE,  ER,  AR,  BR,  RC,  RP,  APA,  and  R/R  data.  The  eight  variables  of  DEV, 
MSE,  CR,  DD,  RCP,  MMH,  TNMCM,  and  MC  eould  not  be  eonsidered  from  the  normal 
distribution  as  represented  by  a  p-value  of  less  than  0.05. 


Table  5.  27EW  Shapiro-Wilk  Normality  Test  Results 


27FW  Shapiro-Wilk  Normality  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

DEV 

X 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

X 

CR 

X 

RCP 

X 

X 

RC 

X 

MMH 

X 

X 

RP 

X 

TNMCM 

X 

X 

MC 

X 

388EW.  The  1 1  variables  of  DEV,  SEA,  HUTE,  SUTE,  ER,  BR,  APA,  R/R, 
MMH,  TNMCM,  and  MC  from  the  388PW  all  aeeepted  the  null  hypothesis  with  a  p- 
value  greater  than  0.05.  There  were  nine  variables  eharaeterized  as  being  of  a  non¬ 
normal  distribution.  They  inelude  EHA,  ESE,  MSE,  AR,  CR,  RC,  RP,  DD,  and  RCP  and 
are  depieted  in  Table  6. 
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Table  6.  388FW  Shapiro-Wilk  Normality  Test  Results 


388FW  Shapiro-Wilk  Normality  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

DEV 

X 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

SEA 

X 

BR 

X 

R/R 

X 

FSE 

X 

CR 

X 

RCP 

X 

MSE 

X 

RC 

X 

MMH 

X 

X 

RP 

X 

TNMCM 

X 

X 

X 

22ARW.  Data  from  the  22ARW  exposed  9  of  the  17  tested  variables  as  being 
from  a  normal  distribution.  HUTE,  SUTE,  ER,  BR,  CR,  RP,  APA,  DD,  and  MMH  all 
had  suffieient  p-values  whieh  accepted  the  null  hypothesis.  The  other  eight  variables  of 
EHA,  SPA,  MSE,  AR,  RC,  R/R,  TNMCM,  and  MC  were  considered  from  non-normal 
distributions.  Each  possessed  a  p-value  less  than  0.05  which  rejected  the  null  hypothesis. 
Table  7  and  subsequent  tables  include  the  characters  "n/a"  identifying  those  variables  not 
applicable  to  the  test  performed. 


Table  7.  22ARW  Shapiro-Wilk  Normality  Test  Results 


22ARW  Shapiro-Wilk  Normality  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

DEV 

n/a 

n/a 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

RCP 

n/a 

n/a 

MSE 

X 

RC 

X 

MMH 

X 

HUTE 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

X 
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92ARW.  From  the  16  variables  of  the  92ARW,  10  were  categorized  as  being 


normally  distributed  with  p-values  exceeding  the  0.05  level  of  significance.  FHA,  SFA, 
HUTE,  SUTE,  ER,  BR,  RC,  RP,  R/R,  and  TNMCM  all  accepted  the  null  hypothesis. 
Only  the  remaining  six  variables  of  AR,  CR,  APA,  DD,  MMH,  and  MC  rejected  the  null 
hypothesis  and  were  considered  from  a  non-normal  distribution. 


Table  8.  92ARW  Shapiro-Wilk  Normality  Test  Results 


92ARW  Shapiro-Wilk  Normality  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

DEV 

n/a 

n/a 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

RCP 

n/a 

n/a 

MSE 

n/a 

n/a 

RC 

X 

MMH 

X 

HUTE 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

■SB 

X 

319ARW.  Again,  17  variables  were  tested  against  the  null  hypothesis  that  the 
data  were  from  a  normal  distribution.  The  seven  variables  of  SPA,  HUTE,  SUTE,  PR, 
BR,  TNMCM,  and  MC  from  the  319ARW  accepted  the  null  hypothesis  with  p-values 
greater  than  0.05.  PHA,  MSE,  AR,  CR,  RC,  RP,  APA,  DD,  R/R,  and  MMH  were  the 
other  variables  considered  from  non-normal  distributions  by  their  respective  p-values. 
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Table  9.  319ARW  Shapiro-Wilk  Normality  Test  Results 


319ARW  Shapiro-Wilk  Normality  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

Variable 

Normal 

Non-Normal 

DEV 

n/a 

n/a 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

RCP 

n/a 

n/a 

MSE 

X 

RC 

X 

MMH 

X 

HUTE 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

X 

Variance  Tests 

Varianee  tests  were  used  as  the  seeond  step  in  determining  the  eomposition  of 
sample  data.  They  were  also  used  in  reeognizing  ehanges  that  may  have  oeeurred 
following  the  implementation  of  the  eombat  wing  strueture.  Homogeneity  of  varianee 
was  first  tested  to  overeome  the  assumption  of  equal  varianee  between  data  sets.  Next, 
sample  varianees  of  eaeh  variable  were  identified  and  evaluated  for  the  direetion  of 
ehange  that  oeeurred  between  pre-  and  post-implementation  data. 

Results  of  the  Levene  test  yielded  31  out  of  the  110  total  variables  displaying 
unequal  varianee  eharaeteristies.  Similarity  in  varianee  was  deteeted  in  79  variables  by 
way  of  p-values  whieh  aeeepted  the  null  hypothesis  that  the  varianees  were  equal.  Of  the 
31  variables  identified  as  unequal,  13  were  determined  to  have  improved  through  a 
deerease  in  varianee.  The  remaining  18  variables  demonstrated  a  worsening  in  results 
refleeted  by  an  inerease  in  varianee.  Detailed  analysis  results  and  data  tables  representing 
the  tests  for  equal  varianee  and  direetion  of  ehange  are  found  in  Appendix  F. 

20FW.  There  were  6  variables  from  the  20FW  whieh  possessed  unequal  varianee 
and  14  that  were  determined  to  be  equal.  A  p-value  of  less  than  0.05  was  obtained  for  the 
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variables  of  DEV,  FSE,  MSE,  BR,  APA,  and  MMH  rejecting  the  null  hypothesis.  EHA, 
SEA,  HUTE,  SUTE,  ER,  AR,  CR,  RC,  RP,  DD,  R/R,  RCP,  TNMCM,  and  MC  all 
demonstrated  p-values  which  allowed  accepting  that  their  variances  were  equal. 

Upon  recognition  of  the  six  variables  with  unequal  variance,  further  examination 
was  conducted  to  determine  the  direction  of  change  which  occurred.  The  three  Overall 
Balance  variables  of  DEV,  ESE,  and  MSE  all  showed  improvements  through  a  decrease 
in  variance.  In  contrast,  the  Sortie  Production  variable  of  BR  and  two  Fleet  Health 
variables  of  APA  and  MMH  demonstrated  degraded  performance  through  an  increase  in 
variance.  Table  10  identifies  those  variables  determined  to  have  unequal  variance  and/or 
improved  variance  by  the  mark  in  the  respective  column. 


Table  10.  20FW  Eevene  Homogeneity  of  Variance  Test  Results 


20FW  Variance  T est 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

DEV 

X 

X 

FR 

APA 

X 

FHA 

AR 

DD 

X 

SFA 

BR 

X 

R/R 

X 

FSE 

X 

X 

CR 

RCP 

MSE 

X 

X 

RC 

X 

MMH 

X 

HUTE 

RP 

TNMCM 

SUTE 

■SB 

27FW.  Data  from  the  27FW  exposed  4  variables  with  unequal  variance  and  16 
variables  characterized  with  equal  variance.  Only  CR,  APA,  DD,  and  R/R  rejected  the 
null  hypothesis  with  p-values  of  less  than  0.05,  classifying  their  variances  as  unequal. 
The  p-values  of  DEV,  EHA,  SEA,  FSE,  MSE,  HUTE,  SUTE,  FR,  AR,  BR,  RC,  RP, 
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RCP,  MMH,  TNMCM,  and  MC  all  exceeded  0.05.  By  accepting  the  null  hypothesis, 
these  variables  were  all  considered  having  equal  variance. 

One  Sortie  Production  variable  and  two  Fleet  Health  variables  showed  improved 
variance  between  pre-  and  post-implementation  data.  These  variables  were  BR,  APA, 
and  R/R  respectively.  Only  the  Fleet  Health  variable  of  DD  showed  an  apparent  increase 
and  subsequent  worsening  in  variance. 


Table  11.  27FW  Levene  Homogeneity  of  Variance  Test  Results 


27FW  Variance  T est 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

DEV 

X 

FR 

APA 

X 

X 

FHA 

AR 

DD 

X 

SFA 

X 

BR 

X 

R/R 

X 

X 

FSE 

CR 

X 

X 

RCP 

X 

MSE 

X 

RC 

X 

MMH 

HUTE 

RP 

X 

TNMCM 

X 

SUTE 

X 

388FW.  Only  2  of  the  20  total  variables  from  the  388FW  rejected  the  null 
hypothesis  and  were  considered  having  unequal  variance.  MSB  and  APA  were  the  only 
two  variables  with  a  p-value  less  than  the  0.05  significance  level  representing  unequal 
variance.  The  remaining  variables  obtained  p-values  greater  than  0.05  and  were 
considered  having  equal  variance.  These  18  variables  included  DEV,  FHA,  SFA,  FSB, 
HUTE,  SUTE,  ER,  AR,  BR,  CR,  RC,  RP,  DD,  R/R,  RCP,  MMH,  TNMCM,  and  MC. 

Both  the  Overall  Balance  variable,  MSB,  and  Elect  Health  variable,  APA, 
exhibited  improved  variance  following  the  change  in  organizational  structure. 
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Table  12.  388FW  Levene  Homogeneity  of  Varianee  Test  Results 


388FW  Variance  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

DEV 

X 

FR 

APA 

X 

X 

FHA 

AR 

DD 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

CR 

RCP 

X 

MSE 

X 

X 

RC 

MMH 

HUTE 

RP 

X 

TNMCM 

X 

SUTE 

X 

22ARW.  There  were  5  of  17  variables  from  the  22ARW  that  had  p-values  less 
than  0.05,  rejeeting  the  null  hypothesis  that  their  varianees  were  equal.  FHA,  SFA, 
HUTE,  SUTE,  and  DD  were  elassified  as  having  unequal  varianee.  The  other  12 
variables  all  possessed  p-values  whieh  were  greater  than  0.05.  Equal  varianee  was 
identified  for  MSE,  ER,  AR,  BR,  CR,  RC,  RP,  APA,  R/R,  MMH,  TNMCM,  and  MC. 

All  four  Overall  Balanee  variables  reeognized  with  unequal  varianee  experieneed 
a  worsening  in  variability.  Ineluded  were  the  variables  EHA,  SPA,  HEITE,  and  SUTE. 

In  eontrast,  the  Pleet  Health  variable  of  DD  demonstrated  improvement  through  a  notable 
deerease  in  varianee. 


Table  13.  22ARW  Eevene  Homogeneity  of  Varianee  Test  Results 


22ARW  Variance  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

DEV 

n/a 

n/a 

FR 

X 

APA 

FHA 

X 

AR 

X 

DD 

X 

X 

SFA 

X 

BR 

R/R 

FSE 

n/a 

n/a 

CR 

RCP 

n/a 

n/a 

MSE 

X 

RC 

MMH 

X 

HUTE 

X 

RP 

TNMCM 

X 

SUTE 

X 

X 
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92ARW.  The  92ARW  possessed  6  of  16  variables  with  p-values  less  than  the 


0.05  signifieanee  level.  FHA,  SFA,  HUTE,  SUTE,  APA,  and  MC  rejeeted  the  null 
hypothesis  that  the  variances  were  equal.  The  other  ten  variables  had  p-values  greater 
than  0.05  and  were  all  considered  having  equal  variance.  These  variables  included:  ER, 
AR,  BR,  CR,  RC,  RP,  DD,  R/R,  RCP,  MMH,  and  TNMCM. 

Again,  the  Overall  Balance  variables  EHA,  SPA,  HUTE,  and  SUTE  depicted 
unequal  variance  and  a  degrading  in  measured  value.  The  Elect  Health  variable  APA 
also  exhibited  these  same  characteristics.  MC,  another  Elect  Health  variable,  did 
however  demonstrate  a  considerable  improvement  in  variance. 


Table  14.  92ARW  Eevene  Homogeneity  of  Variance  Test  Results 


92ARW  Variance  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

DEV 

n/a 

n/a 

FR 

APA 

X 

FHA 

X 

AR 

DD 

SFA 

X 

BR 

R/R 

X 

FSE 

n/a 

n/a 

CR 

RCP 

n/a 

n/a 

MSE 

n/a 

n/a 

RC 

X 

MMH 

HUTE 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

X 

X 

319ARW.  Just  fewer  than  one-half  of  the  17  variables  from  the  319ARW 
contained  p-values  of  less  than  0.05  which  rejected  the  null  hypothesis.  Unequal 
variance  was  considered  for  the  variables  of  EHA,  SPA,  MSE,  HUTE,  SUTE,  BR,  CR, 
and  APA.  The  remaining  nine  variables  of  PR,  AR,  RC,  RP,  DD,  R/R,  MMH,  TNMCM, 
and  MC  possessed  p-values  exceeding  0.05. 
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All  five  Overall  Balanee  variables  depicted  unequal  variance  and  degraded 
measurements  of  variability.  FHA,  SFA,  MSB,  HUTE,  and  SUTE  all  had  sizeable 
increases  in  variance  for  post-implementation  data.  In  contrast,  two  Sortie  Production 
variables  and  one  Elect  Health  variable  demonstrated  significant  improvements  in 
variance.  BR,  CR,  and  APA  obtained  measurable  decreases  in  variance  under  the  combat 
wing  structure. 


Table  15.  319ARW  Eevene  Homogeneity  of  Variance  Test  Results 


319ARW  Variance  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

Variable 

Unequal 

Improved 

DEV 

n/a 

n/a 

FR 

X 

APA 

X 

X 

FHA 

X 

AR 

DD 

SFA 

X 

BR 

X 

X 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

X 

RCP 

n/a 

n/a 

MSE 

X 

RC 

X 

MMH 

HUTE 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

X 

Comparison  of  Means  Tests 

These  tests  were  conducted  in  two  phases  similar  to  the  variance  tests  exposing 
the  results  for  this  next  critical  portion  of  the  analysis.  The  first  phase  analyzed  changes 
in  measurements  using  an  appropriate  means  comparison  test  to  determine  if  differences 
between  mean  values  were  significant.  During  the  second  phase,  the  mean  values  of  each 
variable  were  identified  and  evaluated  for  the  direction  of  change  that  occurred  between 
pre-  and  post-implementation  data.  Summary  tables  for  each  aircraft  unit  were  then 
developed  to  illustrate  the  outcomes  of  both  test  phases. 
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Results  of  the  means  eomparison  tests  yielded  59  out  of  the  110  total  variables 
displaying  significant  differences  in  mean  value.  No  noticeable  changes  were  detected  in 
5 1  variables  by  way  of  p-values  which  accepted  the  null  hypothesis  that  the  mean  values 
were  equal.  Of  the  59  variables  identified  as  significantly  different,  37  were  determined 
to  have  improved  in  mean  value.  The  remaining  22  variables  demonstrated  a  worsening 
in  results  reflected  by  a  degraded  mean  value.  Detailed  analysis  results  and  tables 
representing  the  means  comparisons  and  direction  of  change  in  mean  value  for  each  unit 
are  portrayed  in  Appendix  G. 

20FW.  Data  from  1 1  of  the  20  variables  analyzed  from  the  20FW  displayed 
changes  of  significance  through  their  appropriate  comparison  of  means  test.  There  were 
four  Overall  Balance,  four  Sortie  Production,  and  three  Fleet  Health  Indicators  evaluated 
for  improvements  to  mean  value.  The  p-value  of  DEV,  FHA,  SFA,  MSE,  ER,  AR,  BR, 
RC,  APA,  DD,  and  MMH  all  exceeded  0.05  suggesting  the  two  compared  values  were 
significantly  different. 

Upon  further  analysis,  the  four  variables  of  DEV,  MSE,  RC,  and  DD  all  showed 
significant  improvement  in  mean  value.  In  contrast,  EHA,  SEA,  ER,  AR,  BR,  APA,  and 
MMH  all  portrayed  a  worsening  in  mean  value.  A  summary  of  the  results  obtained  from 
the  20PW  is  depicted  in  Table  16. 
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Table  16.  20FW  Means  Comparison  Test  Results 


20FW  M  eans  Comparison  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

DEV 

X 

X 

FR 

X 

APA 

X 

FHA 

X 

AR 

X 

DD 

X 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

X 

CR 

RCP 

MSE 

X 

X 

RC 

X 

X 

MMH 

X 

HUTE 

X 

RP 

X 

TNMCM 

SUTE 

■SB 

X 

27FW.  The  27FW  data  showed  eonsiderable  ehanges  oeeurred  to  9  of  20  the 
variables  tested.  Two  Overall  Balanee,  three  Sortie  Produetion,  and  four  Fleet  Health 
Indieators  all  demonstrated  signifieant  differenee  between  pre-  and  post-implementation 
data.  DEV,  FSE,  ER,  BR  RP,  APA,  RCP,  TNMCM,  and  MC  all  eontained  p-values  of 
less  than  0.05  whieh  rejeeted  the  null  hypothesis. 

The  eight  variables  of  DEV,  ESE,  ER,  RP,  APA,  RCP,  TNMCM,  and  MC  all 
demonstrated  improvement  in  mean  values.  BR  was  the  only  variable  to  show  a 
measurable  worsening  in  mean  value. 


Table  17.  27PW  Means  Comparison  Test  Results 


27FW  M  eans  Comparison  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

DEV 

X 

X 

FR 

X 

X 

APA 

X 

X 

FHA 

AR 

DD 

SFA 

BR 

X 

R/R 

X 

FSE 

X 

X 

CR 

X 

RCP 

X 

X 

MSE 

X 

RC 

X 

MMH 

HUTE 

RP 

X 

X 

TNMCM 

X 

X 

SUTE 

■B 

X 

X 
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388FW.  There  were  1 1  variables  whieh  displayed  signifieant  ehanges  between 
data  sets  from  the  388FW.  Three  Overall  Balanee,  two  Sortie  Produetion,  and  six  of  the 
Fleet  Health  indieators  eontained  p-values  that  rejeeted  the  null  hypothesis  that  the  means 
were  the  same.  DEV,  FHA,  MSE,  AR,  BR,  APA,  DD,  RCP,  MMH,  TNMCM,  and  MC 
were  all  determined  to  have  signifieantly  different  values  following  the  reorganization 
and  required  further  inquiry. 

Improvements  in  mean  values  were  observed  by  the  variables  of  DEV,  EHA, 
MSE,  APA,  DD,  TNMCM,  and  MC.  Conversely,  the  variables  of  AR,  BR,  RCP,  and 
MMH  were  all  shown  to  have  unwanted  ehanges  in  mean  values. 


Table  18.  388PW  Means  Comparison  Test  Results 


388FW  M  eans  Comparison  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

DEV 

X 

X 

FR 

X 

APA 

X 

X 

FHA 

X 

X 

AR 

X 

DD 

X 

X 

SFA 

X 

BR 

X 

R/R 

X 

FSE 

X 

CR 

RCP 

X 

MSE 

X 

X 

RC 

MMH 

X 

HUTE 

X 

RP 

X 

TNMCM 

X 

X 

SUTE 

X 

X 

22ARW.  Analysis  of  the  22ARW  data  identified  11  of  17  variables  having  p- 
values  whieh  indieated  signifieant  ehanges  in  mean  values.  Overall  Balanee  and  Sortie 
Produetion  both  eontained  four  variables  and  Eleet  Health  possessed  three  variables. 
PSA,  SPA,  MSE,  HUTE,  PR,  AR,  CR,  RC,  APA,  R/R,  and  MMH  all  rejeeted  the  null 
hypothesis  that  the  means  were  the  same.  Additional  investigation  was  eondueted  on 
these  variables. 
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Further  examination  showed  improvements  to  mean  values  in  7  of  the  1 1 
variables  that  were  previously  identified  with  significant  changes.  They  included  the 
variables  of  FHA,  SFA,  HUTE,  AR,  CR,  APA,  and  MMH.  Alternatively,  the  variables 
of  MSE,  ER,  RC,  and  R/R  had  unwanted  directional  changes  in  mean  value. 


Table  19.  22ARW  Means  Comparison  Test  Results 


22ARW  M  eans  Comparison  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

DEV 

n/a 

n/a 

FR 

X 

APA 

X 

X 

FHA 

X 

X 

AR 

X 

X 

DD 

X 

SFA 

X 

X 

BR 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

X 

RCP 

n/a 

n/a 

MSE 

X 

RC 

X 

MMH 

X 

X 

HUTE 

X 

X 

RP 

TNMCM 

X 

SUTE 

X 

92ARW.  Eor  the  92ARW,  means  comparison  tests  identified  8  of  the  16  total 
variables  tested  as  showing  significant  changes  between  pre-  and  post-implementation 
data.  Three  Overall  Balance,  one  Sortie  Production,  and  four  Elect  Health  variables 
rejected  the  null  hypothesis  that  the  means  were  the  same.  EHA,  SEA,  HUTE,  CR,  APA, 
DD,  TNMCM,  and  MC  contained  p-values  less  than  the  0.05  level  of  significance  and 
were  evaluated  for  direction  of  change. 

A  desirable  improvement  in  mean  value  and  variance  was  found  in  the  variables 
of  EHA,  SEA,  HUTE,  CR,  APA,  TNMCM,  and  MC.  Only  one  variable,  DD,  had  a 
degraded  mean  value  following  the  change  to  organizational  structure. 
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Table  20.  92ARW  Means  Comparison  Test  Results 


92ARW  M  eans  Comparison  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

DEV 

n/a 

n/a 

FR 

APA 

X 

X 

FHA 

X 

X 

AR 

DD 

X 

SFA 

X 

X 

BR 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

X 

RCP 

n/a 

n/a 

MSE 

n/a 

n/a 

RC 

X 

MMH 

X 

HUTE 

X 

X 

RP 

X 

TNMCM 

X 

X 

SUTE 

X 

X 

X 

319ARW.  Signilieant  ehanges  were  identified  in  9  of  the  17  variables  from  the 
319ARW.  All  five  Overall  Balance,  two  Sortie  Production,  and  two  Fleet  Health 
indicator  variables  rejected  the  null  hypothesis  with  p-values  less  than  0.05.  FHA,  SFA, 
MSB,  HUTE,  SUTE,  AR,  CR,  APA,  and  MC  all  had  significant  changes  in  mean  value 
and  were  investigated  further. 

An  improved  mean  value  was  observed  in  the  variables  of  EHA,  SPA,  HUTE, 
SUTE,  CR,  APA,  and  MC.  In  contrast,  both  MSE  and  AR  possessed  degraded  mean 
values. 


Table  21 .  3 19ARW  Means  Comparison  Test  Results 


319ARW  M  eans  Comparison  Test 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

Variable 

Different 

Improved 

DEV 

n/a 

n/a 

FR 

X 

APA 

X 

X 

FHA 

X 

X 

AR 

X 

DD 

X 

SFA 

X 

X 

BR 

X 

R/R 

X 

FSE 

n/a 

n/a 

CR 

X 

X 

RCP 

n/a 

n/a 

MSE 

X 

RC 

X 

MMH 

X 

HUTE 

X 

X 

RP 

X 

TNMCM 

X 

SUTE 

X 

X 

X 

X 
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Qualitative  Summary  Results 

The  results  from  the  previous  two  phases  of  the  analysis  were  combined  and 
categorized  using  the  nine  possible  alternatives  described  in  the  methodology.  This  data 
was  plotted  for  each  variable  to  expose  any  patterns  in  the  results.  Two  separate  data 
plots  were  developed  for  each  aircraft  type  with  a  specific  focus  on  either  mean  or 
variance.  Then,  a  transformation  was  performed  to  quantify  the  data  into  measurable 
information  for  further  consideration.  Weighted  factoring  was  then  applied  to 
appropriately  evaluate  detected  changes.  Data  plots  used  for  this  portion  of  the  analysis 
are  provided  in  Appendix  H.  The  following  paragraphs  present  summary  results  obtained 
for  each  individual  aircraft  type  and  an  overall  combined  summary. 

F-16  Summary.  When  evaluating  the  categorical  data  plots  of  the  F-16  aircraft 
units,  clearly  recognizable  patterns  were  apparent.  First,  it  was  observed  that  a  sizeable 
number  of  variables  displayed  universal  improvements  in  mean  value.  Fleet  Health  was 
the  primary  beneficiary  with  a  pattern  of  improvement  surrounding  the  indicators  of 
APA,  DD,  TNMCM,  and  MC.  Additionally,  Overall  Balance  indicators  of  DEV  and 
MSE  showed  enhanced  mean  values.  In  contrast,  only  a  small  detectable  pattern  was 
evident  in  Sortie  Production  with  universally  degraded  mean  values  to  both  AR  and  BR. 
Elect  Health  portrayed  one  indicator,  MMH,  which  appeared  to  have  worsened  in  this 
aspect.  When  observing  the  impact  on  variance,  an  overwhelming  majority  were  not 
influenced.  The  Overall  Balance  variable  MSE  and  Elect  Health  variable  APA  were  the 
only  two  with  a  noticeable  array,  both  indicating  a  positive  effect  on  variability. 

Upon  consolidating  this  information  by  category  and  transposing  it  to  numerical 
values,  it  was  identified  that  nearly  60  percent  of  the  variables  displayed  considerable 
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changes.  Evaluating  these  changes,  37  percent  of  the  total  variables  showed  sizable 
improvements  in  either  mean  value  or  varianee.  The  most  notieeable  were  gains  in  mean 
value  without  affeeting  variance  which  occurred  to  23  percent  of  the  variables.  Just  as 
important  to  realize  is  that  less  than  20  pereent  were  negatively  impaeted  sinee  the 
reorganization  was  performed.  Table  22  portrays  the  eollective  numerieal  results 
obtained  for  the  F-16  aireraft. 


Table  22.  F-16  MeansA^ariance  Summary  Results 


F-16 

Summary 

Variable 

-HVl  ,+V 

-HVl  ,=V 

=M  ,+V 

-HVl  ,-V 

=M  ,=V 

-M  ,+V 

=M  ,-V 

-M,=V 

-M  ,-V 

Total 

OVERALL 

BALANCE 

3 

D 

1 

0 

11 

0 

0 

2 

0 

21 

SORTIE 

PRODUCTION 

0 

3 

1 

0 

8 

0 

0 

5 

1 

18 

FLEET  HEALTH 

2 

7 

1 

0 

6 

0 

1 

2 

2 

21 

Total 

5 

n 

3 

0 

25 

0 

1 

9 

3 

60 

Percent 

8.33% 

23.33% 

5.00% 

0.00% 

41.67% 

0.00% 

1.67% 

15.00% 

5.00% 

100.00% 

This  information  was  then  assessed  using  the  weighted  faetor  analysis  described 
in  the  methodology  portion  of  this  research.  Table  19  depiets  the  weight  value  applied 
above  eaeh  of  the  respeetive  categories.  Values  were  calculated  for  each  classification 
and  variable  type  followed  by  category  totals.  The  performanee  indicators  of  Overall 
Balanee  and  Fleet  Health  reeeived  positive  scores  of  nine  (+9)  and  five  (+5)  respectively. 
Using  these  quantities,  both  areas  were  deemed  to  have  improved  since  implementing  the 
combat  wing  structure.  Sortie  Production,  however,  was  determined  to  have  worsened 
under  this  structure  with  a  score  of  negative  three  (-3).  Combining  this  information,  the 
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F-16  aircraft  appeared  to  benefit  overall  with  a  score  of  positive  eleven  (+1 1).  These 
results  are  portrayed  in  Table  23. 


Table  23.  F-16  Weighted  Factor  Results 


F-16 

Weighted  F acto r  Sum mary 

Weighted 

Value 

2 

1 

1 

0 

0 

0 

-1 

-1 

-2 

Variable 

-HVl  ,+V 

-HVl  ,=V 

=IVl  ,+V 

-HVl  ,-V 

=M  =V 

-M  ,+V 

=lVl  ,-V 

-M  ,=V 

-M  ,-V 

Total 

OVERALL 

BALANCE 

6 

D 

1 

0 

0 

0 

0 

-2 

0 

9 

SORTIE 

PRODUCTION 

0 

3 

1 

0 

0 

0 

0 

-5 

-2 

-3 

FLEET  HEALTH 

4 

7 

1 

0 

0 

0 

-1 

-2 

-4 

5 

Total 

10 

14 

3 

0 

0 

0 

-1 

-9 

-6 

11 

KC-135  Summary.  As  done  with  the  F-16  aireraft,  eategorieal  data  plots  for  the 
KC-135  were  first  analyzed  for  deteetable  patterns.  Again,  desirable  improvements  in 
mean  value  were  evident  in  numerous  areas.  Tight  groupings  surrounded  the  Overall 
Balance  indicators  FHA,  SFA,  and  HUTE.  Equally  noticeable  was  the  cluster  around  the 
Sortie  Production  variable  of  CR.  Eleet  Health  also  demonstrated  consistent  gains  to 
APA  quantities.  Universal  degradation  to  mean  values  was  nearly  undetectable  with  the 
Overall  Balanee  indicator  of  MSE  being  the  only  variable  under  possible  consideration. 
When  observing  the  impacts  on  variability,  Overall  Balance  portrayed  the  only  patterns 
which  were  all  negative.  FHA,  SFA,  HUTE,  and  SUTE  all  suffered  with  increased 
variance  subsequent  to  the  implementation  of  the  combat  wing  structure. 

Numerieal  values  were  again  tabulated  for  eaeh  of  the  different  variable  types  and 
change  classifications.  Once  more,  a  comparative  62  percent  of  the  total  variables 
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demonstrated  evident  changes  to  either  mean  value  or  variance.  A  cumulative  24  percent 
of  the  variables  showed  only  improvements  in  both  areas.  An  additional  22  percent 
rendered  an  enhancement  in  mean  values,  but  were  combined  with  degraded  variance. 
Only  18  percent  of  the  total  variables  depicted  a  worsening  in  mean  value  or  variance. 
The  information  previously  described  is  presented  in  its  entirety  in  Table  24. 


Table  24.  KC-135  MeansA^ariance  Summary  Results 


KC-135 

Summary 

Variable 

+M  ,+V 

-HVl  ,=V 

=IVl  ,4V 

4M  ,-V 

=M  ,=V 

-M  ,4V 

=M  ,-V 

-M  ,=V 

-M  ,-V 

Total 

OVERALL 

BALANCE 

0 

0 

0 

10 

0 

0 

2 

1 

1 

14 

SORTIE 

PRODUCTION 

1 

3 

1 

0 

10 

0 

0 

3 

0 

18 

FLEET  HEALTH 

2 

4 

1 

1 

8 

0 

0 

2 

0 

18 

Total 

3 

7 

2 

11 

18 

0 

2 

6 

1 

50 

Percent 

6.00% 

14.00% 

4.00% 

22.00% 

36.00% 

0.00% 

4.00% 

12.00% 

2.00% 

100.00% 

Using  the  weighted  factors  analysis  as  before,  the  outcome  was  shown  to  have 
improved  overall  KC-135  aircraft  maintenance  actions.  Overall  Balance  was  inferior  to 
previous  performance  scoring  negative  five  (-5).  On  the  contrary.  Sortie  Production  and 
Fleet  Health  were  enhanced  acquiring  individual  scores  of  positive  three  (+3)  and 
positive  seven  (+7).  Final  computations  resulted  in  attaining  a  cumulative  score  of 
positive  five  (+5)  for  this  aircraft. 
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Table  25.  KC-135  Weighted  Faetor  Results 


KC-135 

Weighted  F acto r  Sum mary 

Weighted 

Value 

2 

1 

1 

0 

0 

0 

-1 

-1 

-2 

Variable 

-HVI  ,+V 

-HVI  ,=V 

=IVI  ,+V 

-HVI  ,-V 

=M  ,=V 

-M  ,+V 

=IV1  ,-V 

-M  ,=V 

-M  ,-V 

Total 

OVERALL 

BALANCE 

0 

0 

0 

0 

0 

0 

-2 

-1 

-2 

-5 

SORTIE 

PRODUCTION 

2 

3 

1 

0 

0 

0 

0 

-3 

0 

3 

FLEET  HEALTH 

4 

4 

1 

0 

0 

0 

0 

-2 

0 

7 

Total 

6 

7 

2 

0 

0 

0 

-2 

-6 

-2 

5 

Overall  Results  Summary.  To  gain  insight  into  the  overall  impaet  to  the  Air 
Foree  as  a  whole,  results  from  both  aireraft  types  were  eombined  and  analyzed.  As 
expeeted,  60  pereent  of  the  110  variables  showed  ehanges  of  one  type  or  another. 
Calculations  revealed  30  percent  of  the  total  experienced  only  positive  effects.  Another 
10  percent  recognized  equally  improvements  to  mean  value,  but  were  combined  with  an 
increase  in  variability.  Merely  19  percent  of  the  total  variables  displayed  progress  solely 
in  an  unfavorable  direction.  These  results  are  depicted  in  Table  26. 


Table  26.  Overall  MeansWariance  Summary  Results 


Overall 

Summary 

Variable 

-HVI  ,+V 

-HVI  ,=V 

=M  ,+V 

-HVI  ,-V 

=M  ,=V 

-M  ,+V 

=M  ,-V 

-M  ,=V 

-M  ,-V 

Total 

OVERALL 

BALANCE 

3 

4 

1 

10 

11 

0 

2 

3 

1 

35 

SORTIE 

PRODUCTION 

1 

6 

2 

0 

18 

0 

0 

8 

1 

36 

FLEET  HEALTH 

4 

11 

2 

1 

14 

0 

1 

4 

2 

39 

T  otal 

8 

21 

5 

11 

43 

0 

3 

15 

4 

110 

Percent 

7.27% 

19.09% 

4.55% 

10.00% 

39.09% 

0.00% 

2.73% 

13.64% 

3.64% 

100.00% 
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After  applying  weighted  factors,  category  totals  revealed  definitive  improvements 
in  performance.  Overall  Balance  portrayed  an  enhancement  with  a  total  score  of  positive 
four  (+4).  Sortie  Production  demonstrated  a  neutral  outcome  balancing  out  with  a  score 
of  zero  (0).  Fleet  Health  showed  an  overwhelming  improvement  with  a  resulting  score  of 
positive  twelve  (+12).  An  overall  enhancement  to  aircraft  maintenance  performance  was 
achieved  represented  by  a  score  of  positive  sixteen  (+16). 


Table  27.  Overall  Weighted  Factor  Summary  Results 


Overall 

Weighted  F acto r  Sum mary 

Weighted 

Value 

2 

1 

1 

0 

0 

0 

-1 

-1 

-2 

Variable 

-HVl  ,+V 

-HVl  ,=V 

=M  ,+V 

-HVl  ,-V 

=M  =V 

-M  ,+V 

=M  ,-V 

-M  ,=V 

-M  ,-V 

Total 

OVERALL 

BALANCE 

6 

4 

1 

0 

0 

0 

-2 

-3 

-2 

D 

SORTIE 

PRODUCTION 

2 

6 

2 

0 

0 

0 

0 

-8 

-2 

0 

FLEET  HEALTH 

8 

11 

2 

0 

0 

0 

-1 

-4 

-4 

12 

T  otal 

16 

21 

5 

0 

0 

0 

-3 

-15 

-8 

16 

Sensitivity  Analysis.  Next,  sensitivity  analysis  was  performed  to  understand  the 
implications  of  selecting  equal  weights  for  changes  in  mean  value  and  variance.  It  was 
apparent  that  most  reports  and  briefings  used  to  convey  performance  results  did  not 
consider  variance.  For  this  reason,  the  weight  applied  to  changes  in  variance  was  reduced 
from  one  to  zero  in  one-tenth  increments  for  both  aircraft  types  and  the  overall  summary 
results.  The  effects  of  these  changes  were  then  analyzed  for  impact  on  the  previously 
obtained  results.  The  following  paragraphs  describe  the  outcome  of  this  analysis. 
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Figure  10  portrays  the  impact  of  changing  the  weight  applied  to  differences  in 
variance  on  each  of  the  three  F-16  performance  indicators  and  the  total.  It  is  made 
apparent  that  Overall  Balance,  Fleet  Health,  and  the  summary  total  still  remain  positive 
numbers.  Sortie  Production  is  unaffected  by  the  changes  and  remains  constant  at 
negative  three  (-3).  This  indicates  that  previously  obtained  results  are  resolute  in  their 
depiction  of  F-16  aircraft  maintenance  performance. 


Figure  10.  F-16  Sensitivity  Analysis  of  Weighted  Variance 


The  same  procedures  were  performed  for  the  KC-135  aircraft  and  are  presented  in 
Figure  1 1.  As  the  weight  given  to  variance  is  reduced,  the  Overall  Balance  indicator 
reverts  from  negative  to  positive  at  approximately  0.6.  The  two  other  indicators  and  the 
total  all  remain  above  zero  throughout  the  entire  range  of  variance  weights.  This  denotes 
that  if  changes  in  variance  are  considered  one-half  as  important  as  changes  in  mean  value 
or  less,  every  aspect  of  KC-135  aircraft  maintenance  performance  achieved  positive 
results. 
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KC-135  Sensitivity  Analysis  Results 
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BALANCE 
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PRODUCTION 
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Figure  11.  KC-135  Sensitivity  Analysis  of  Weighted  Variance 


The  final  step  in  performing  sensitivity  analysis  involved  observing  the  effects  on 
the  combined  performance  indicators  of  both  aircraft.  Figure  12  represents  the  impact  of 
the  diminishing  values  given  to  changes  in  variance  on  overall  performance  indicators 
and  assessment  total.  First  to  point  out  is  that  the  comprehensive  total  indication  shows 
that  performance  fell  substantially  above  zero  on  the  scale.  This  fact  is  further  enhanced 
with  the  reduction  of  weight  assigned  to  changes  in  variance.  Additionally,  both  Overall 
Balance  and  Fleet  Health  also  shared  these  favorable  results  resting  well  into  the  positive 
range.  Sortie  Production,  however,  begins  a  slight  decline  into  small  negative  numbers 
from  its  origin  at  zero  on  the  weighted  value  scale. 
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Overall  Aircraft  Sensitivity  Results 
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Figure  12.  Overall  Sensitivity  Analysis  of  Weighted  Varianee 


Trend  Analysis 

To  further  enhanee  the  study,  analysis  proeedures  extended  into  an  investigation 
of  resultant  trends  in  aireraft  maintenance  metrics.  Line  charts  were  used  to  document 
maintenance  measurements  for  each  variable  over  both  collection  periods.  Then,  linear 
regression  was  used  to  determine  and  plot  trend  lines  in  the  data.  Once  identified,  these 
trends  were  compared  to  one  another  to  recognize  any  improvement/degradation  toward 
the  desired  direction  of  the  metric. 

Results  of  the  trend  analysis  tests  identified  42  out  of  the  110  total  variables 
displaying  significant  changes  in  trend  direction.  No  change  was  noted  in  the  remaining 
68  variables.  Of  the  42  variables  identified  as  significantly  different,  26  were  determined 
to  have  made  an  improvement  in  trend  direction.  The  other  16  variables  demonstrated  an 
undesirable  change  in  trend  direction.  There  were  12  variables  from  the  combined  trends 
that  were  characterized  as  changing  significantly  which  were  removed  from  further  use 
due  to  uncertainty  in  the  trend.  The  following  paragraphs  present  the  results  obtained  for 
each  aircraft  unit  and  a  combined  quantitative  outcome  of  this  portion  of  the  study. 
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Supporting  linear  regression  analysis  tables  used  in  this  portion  of  the  research  are  shown 
in  Appendix  I. 

20FW.  Upon  evaluating  the  trends  in  data  from  the  20FW,  six  variables  showed 
significant  differences  between  pre-  and  post-combat  wing  structures.  This  was 
represented  by  a  p-value  of  less  than  0.05  when  using  the  comparison  of  regression  lines 
model  which  rejected  the  null  hypothesis  that  the  slopes  the  same.  One  Sortie  Production 
variable,  BR,  and  one  Fleet  Health  variable,  MMH,  both  demonstrated  improving  trends 
following  the  comparison.  In  contrast,  three  Overall  Balance  variables  and  one  Fleet 
Health  variable  were  identified  as  shifting  toward  a  worse  direction.  Included  were  DEV, 
FHA,  FSE,  and  APA.  Upon  further  investigation,  the  variables  of  DEV,  ESE,  BR,  and 
MMH  were  eliminated  from  additional  calculations.  The  first  two  appeared  to  have 
leveled  off  at  or  near  a  peak  value  and  the  later  two  appeared  to  be  returning  to  a 
previously  maintained  value.  Table  28  depicts  the  variables  with  significant  differences 
in  trend,  improvements,  and  decision  of  uncertainty  as  indicated  with  a  mark  in  the 
appropriate  column. 


Table  28.  20EW  Trend  Analysis 


20F  W 

T  rend  Analysis  Results 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

DEV 

X 

X 

FR 

APA 

X 

FHA 

X 

AR 

DD 

SFA 

BR 

X 

X 

X 

R/R 

X 

FSE 

X 

X 

CR 

RCP 

X 

MSE 

RC 

X 

MMH 

X 

X 

X 

HUTE 

RP 

X 

TNM  CM 

X 

SUTE 

M  C 

X 
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27FW.  The  data  from  the  27FW  exhibited  ten  variables  with  the  appropriate 
slope  parameter  containing  a  p-value  of  less  than  0.05  depicting  significantly  different 
trends  following  the  implementation  of  the  combat  wing  structure.  This  included  one 
Overall  Balance,  One  Sortie  Production,  and  three  Fleet  Health  variables  which 
demonstrated  significant  improvements  to  their  trend.  The  variables  of  MSB,  RC,  APA, 
DD,  and  MC  all  possessed  these  characteristics.  There  were,  however,  four  Overall 
Balance  variables  and  one  Fleet  Health  variable  which  showed  a  worsening  in  trend. 
DEV,  FHA,  HUTE,  SEITE,  and  MMH  were  all  included  in  this  category.  Elpon 
evaluation,  DEV,  SEITE,  and  DD  were  excluded  from  the  analysis.  Both  DEV  and  SEITE 
appeared  to  level  off  and  the  remaining  variables  looked  as  though  they  were  returning  to 
a  previous  state. 


Table  29.  27EW  Trend  Analysis 


27F  W 

T  rend  Analysis  Results 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

DEV 

X 

X 

FR 

X 

APA 

X 

X 

FHA 

X 

AR 

DD 

X 

X 

X 

SFA 

BR 

X 

X 

R/R 

X 

FSE 

X 

CR 

X 

RCP 

M  SE 

X 

X 

RC 

X 

X 

MMH 

X 

HUTE 

X 

RP 

X 

TNM  CM 

X 

SUTE 

X 

X 

M  C 

X 

X 

388EW.  There  were  seven  variables  from  the  388EW  with  an  appropriate  slope 
parameter  containing  a  p-value  less  than  0.05,  rejecting  the  null  that  the  slopes  were  the 
same.  Two  Sortie  Production  variables  and  two  Elect  Health  exhibited  considerable 
improvements  in  trend  direction.  These  variables  included  ER,  RP,  R/R,  and  MC.  The 


66 


three  remaining  variables  of  APA,  RCP,  and  MMH  all  expressed  degraded  trends.  There 
was  no  uneertainty  surrounding  these  variables  and  therefore  all  seven  were  ineluded  in 
later  ealculations. 


Table  30.  388FW  Trend  Analysis 


388F  W 

T  rend  Analysis  Results 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

DEV 

X 

FR 

X 

X 

APA 

X 

FHA 

X 

AR 

DD 

X 

X 

SFA 

BR 

R/R 

X 

X 

FSE 

X 

CR 

X 

RCP 

X 

M  SE 

X 

RC 

X 

MMH 

X 

HUTE 

X 

RP 

X 

X 

TNM  CM 

X 

SUTE 

M  C 

X 

X 

22ARW.  There  were  five  variables  from  the  22ARW  with  an  appropriate  slope 
parameter  whieh  rejeeted  the  null  hypothesis  and  were  eonsidered  signifieantly  different. 
One  Overall  Balanee  variable,  SUTE,  one  Sortie  Production  variable,  BR,  and  two  Fleet 
Health  variables  all  showed  an  improvement  in  trend  following  the  reorganization.  Only 
the  additional  Fleet  Health  variable,  APA,  showed  a  degrading  in  trend  direction.  Of 
these,  SUTE  and  APA  were  both  barred  from  further  use  as  a  result  of  uncertainty 
regarding  the  reason  for  change.  It  was  perceived  that  these  variables  were  returning  to  a 
previously  maintained  value. 
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Table  3 1 .  22ARW  Trend  Analysis 


22ARW 

T  rend  Analysis  Results 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

DEV 

n/a 

n/a 

n/a 

FR 

X 

X 

APA 

X 

X 

FHA 

X 

X 

AR 

DD 

X 

X 

SFA 

BR 

X 

X 

R/R 

X 

X 

FSE 

n/a 

n/a 

n/a 

CR 

X 

RCP 

n/a 

n/a 

n/a 

M  SE 

X 

X 

RC 

X 

MMH 

X 

X 

HUTE 

X 

RP 

X 

X 

TNM  CM 

X 

SUTE 

X 

X 

X 

M  C 

92ARW.  The  data  from  the  92ARW  exhibited  nine  variables  with  the  appropriate 
slope  parameter  containing  a  p-value  of  less  than  0.05  depicting  significantly  different 
trends  following  the  implementation  of  the  combat  wing  structure.  There  were  four 
Overall  Balance  and  three  Fleet  Health  variables  which  demonstrated  an  improvement  in 
trend  direction.  These  variables  included  FHA,  SFA,  HUTE,  SUTE,  APA,  DD,  and 
MMH  respectively.  Two  additional  Elect  Health  variables,  TNMCM  and  MC,  depicted 
worsening  trend  changes  following  the  reorganization.  These  two  variables,  however, 
and  DD  were  excluded  due  to  uncertainty  involving  trend  direction. 


Table  32.  92ARW  Trend  Analysis 


92ARW 

T  rend  Analysis  Results 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

DEV 

n/a 

n/a 

n/a 

FR 

X 

APA 

X 

X 

FHA 

X 

X 

AR 

X 

DD 

X 

X 

X 

SFA 

X 

X 

BR 

X 

R/R 

FSE 

n/a 

n/a 

n/a 

CR 

X 

RCP 

n/a 

n/a 

n/a 

M  SE 

n/a 

n/a 

n/a 

RC 

X 

MMH 

X 

X 

HUTE 

X 

X 

RP 

X 

TNM  CM 

X 

X 

SUTE 

X 

X 

M  C 

X 

X 
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319ARW.  Five  variables  from  the  319ARW  were  identified  as  having 
signifieantly  different  trends  by  the  appropriate  regression  model  parameter  and  its 
assoeiated  p-value.  One  Overall  Balance,  two  Sortie  Production,  and  one  Fleet  Health 
variable  depicted  improving  trends  following  the  implementation  of  the  combat  wing 
structure.  These  variables  included  FHA,  FR,  BR,  and  MMH.  Only  MSB,  an  Overall 
Balance  variable,  demonstrated  a  significant  degrading  in  direction  of  trend.  All  of  these 
variables  were  able  to  be  used  during  the  next  stage  of  calculations. 


Table  3  3 .  31 9 ARW  T rend  Analysis 


319ARW 

Trend  Analysis  Results 

OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

Variable 

Different 

Improved 

Uncertain 

DEV 

n/a 

n/a 

n/a 

FR 

X 

X 

APA 

X 

FHA 

X 

X 

AR 

X 

DD 

X 

SFA 

X 

BR 

X 

X 

R/R 

X 

FSE 

n/a 

n/a 

n/a 

OR 

X 

RCP 

n/a 

n/a 

n/a 

M  SE 

X 

RC 

X 

MMH 

X 

X 

HUTE 

X 

RP 

X 

TNM  CM 

X 

SUTE 

X 

M  C 

X 

Overall  Summary  Results.  Table  34  lists  the  category  totals  attained  after 
calculations  were  tabulated  for  each  aircraft  unit.  Positive  numbers  in  the  table  indicate 
the  cumulative  number  of  trends  that  reverted  from  an  unwanted  direction  to  a  preferred 
one.  Conversely,  negative  numbers  reflect  the  cumulative  number  of  trends  that  changed 
from  desirable  to  one  that  was  unfavorable.  Separate  totals  can  be  observed  for  each 
aircraft  type,  performance  indicator  classification,  and  overall  total. 
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Table  34.  Overall  Trend  Analysis  Results 


Trend  Analysis  Results  by  Unit 

Unit 

VariableX,^^ 

F-16 

KC-135 

Total 

20FW 

27FW 

388FW 

22ARW 

92ARW 

319ARW 

Overall 

Balance 

-1 

-1 

0 

0 

4 

0 

2 

Sortie 

Production 

0 

1 

2 

1 

0 

2 

6 

Fleet 

Health 

-1 

1 

-1 

2 

2 

1 

4 

Unit  Total 

-2 

1 

1 

3 

6 

3 

12 

Looking  at  aircraft  type  first,  only  minimal  resulting  changes  in  trends  were 
recognized  by  F-16  organizations.  A  slight  negative  trend  was  shared  in  Overall  Balance 
across  two  of  the  three  units  with  the  remaining  unit  showing  no  overall  difference. 

Sortie  Production  demonstrated  a  favoring  toward  improvements  in  direction  of  change 
by  a  majority  of  the  units.  A  mixed  result  was  obtained  in  the  area  of  Fleet  Health  with 
two  units  each  depicting  one  negative  overall  change  in  trend  and  the  third  unit  showing  a 
single  positive  trend  change.  Overall,  the  F-16  acquired  balanced  results  with  an  equal 
number  of  improved  and  degraded  changes  in  trend.  The  KC-135  units  were  able  to 
achieve  notably  consistent  trend  improvements,  as  opposed  to  those  previously  described 
for  the  F-16.  Overall  Balance  contained  two  units  with  no  resulting  changes  and  one  unit 
with  four  positive  changes  in  trend  direction.  One  unit  expressed  no  difference  in  Sortie 
Production  while  the  remaining  two  both  demonstrated  a  positive  direction  of  change. 
Fleet  Health  displayed  increasingly  improved  results,  this  time  with  all  units  achieving 
some  type  overall  improvement  value.  As  a  whole,  the  KC-135  depicted  overwhelmingly 
positive  results  when  observing  changes  in  performance  trends. 
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Upon  reviewing  category  totals  for  Overall  Balance,  Sortie  Production,  and  Fleet 
Health,  all  three  depicted  considerable  positive  outcomes.  The  negative  effects  to  Overall 
Balance  expressed  by  the  F-16  units  were  overshadowed  by  the  positive  effects  of  the 
KC-135.  This  area  was  able  to  achieve  an  overall  score  of  positive  two  (+2).  Sortie 
Production,  however,  demonstrated  universally  improving  trends  across  both  aircraft 
types  and  obtained  a  total  score  of  positive  six  (+6).  The  larger  gains  achieved  by  the 
KC-135  units  again  outweighed  the  losses  of  F-16  units  when  summing  up  the  category 
of  Fleet  Health.  A  value  of  positive  four  (+4)  was  calculated  in  this  area.  When 
evaluating  all  of  the  major  indicators,  it  appears  that  overall  improvements  have  been 
made  to  changes  in  trends  to  aircraft  maintenance  performance.  This  is  reflected  by  all 
positive  numbers  for  the  individual  totals  and  an  overall  total  score  of  positive  twelve 
(+12). 

Summary 

This  chapter  presented  the  results  of  multiple  analytical  methods  used  when 
conducting  this  research.  Common  analysis  assumptions  of  normality  and  variability 
were  first  determined  in  an  effort  to  conduct  further  mathematical  tests.  Following  these 
assessments,  data  comparisons  were  made  along  with  detailed  investigations  into  the 
directional  changes  of  significantly  different  variables.  Notable  data  was  then  classified 
into  a  meaningful  arrangement  and  assigned  value  through  weighted  factoring.  Finally, 
trend  analysis  was  used  to  help  solidify  the  influence  organizational  structure  had  on 
changes  in  aircraft  maintenance  performance. 
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V.  Conclusions  and  Recommendations 

Introduction 

While  attempting  to  find  answers  to  the  questions  posed  at  the  beginning  of  this 
researeh,  numerous  direet  and  indireet  findings  were  made.  The  following  paragraphs 
deseribe  the  eonelusions  to  the  analysis  in  regards  to  the  investigative  questions  and  the 
overall  researeh  question.  They  are  then  followed  by  reeommendations  that  ean  be  made 
from  the  analysis  results  and  additional  recommendations  for  future  research  in  this  area 
of  study. 

Conclusions 

Structural  changes  are  made  to  organizations  with  the  expectation  of  improving 
performance  and/or  efficiencies  within  an  organization.  The  Air  Force  set  out  for  such 
results  when  it  announced  the  implementation  of  the  Combat  Wing  Structure  in  October, 
2002.  Through  an  investigation  of  published  literature,  the  desired  results  were  said  to  be 
focused  on  improvements  to  aircraft  maintenance  in  the  areas  of  Overall  Balance,  Sortie 
Production,  and  Fleet  Health. 

In  answering  the  overall  research  objective,  it  was  concluded  that  converting  to 
the  current  combat  wing  structure  was  effective  in  attaining  its  proposed  outcomes.  Each 
section  of  the  analysis  was  evaluated  and  both  were  in  agreement  when  making  this 
determination.  From  a  comprehensive  perspective  of  analysis  results,  the  majority  of 
areas  within  each  MAJCOM  and  across  the  Air  Force  showed  positive  effects  since  the 
reorganization.  F-16  units  demonstrated  mixed  results  with  substantial  gains  in  Overall 
Balance  and  Fleet  Health  performance  measurements.  They  did,  however,  produce 
undesirable  results  in  Sortie  Production.  To  offset  this  issue,  the  negative  performance 
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measurements  were  shared  improving  performanee  trends  in  the  same  area.  Only  slight 
negative  trends  were  indieated  in  the  areas  of  Overall  Balanee  and  Fleet  Health.  KC-135 
units  aehieved  greater  results  showing  gains  in  two  of  the  three  areas  of  performanee 
measurements  and  all  eategories  of  future  trends.  Overall  Balanee  measurements  were 
the  only  area  of  negative  performanee.  As  a  whole,  all  performanee  and  trend  indieations 
demonstrated  positive  overall  results  with  the  exeeption  of  Sortie  Produetion  performanee 
whieh  was  neutral. 

The  first  and  maybe  most  remarkable  finding  made  during  this  researeh  was  that 
there  is  no  single  metrie  used  to  measure  any  of  the  three  areas  in  whieh  the  Air  Foree 
had  set  out  to  improve  upon.  Without  a  elear  and  identifiable  metrie,  it  is  diffieult,  if  not 
impossible  to  determine  the  effeets  of  managerial  deeisions  on  respeetive  performanee 
faetors.  It  is  also  problematie  in  that  what  one  entity  might  determine  as  essential  to 
measuring  a  eertain  aspeet  of  organizational  effeetiveness,  another  may  not.  From  the 
measurements  seleeted,  it  was  identified  that  similar  metries  are  not  used  aeross 
MAJCOMs,  yet  Overall  Balanee,  Sortie  Produetion,  and  Fleet  Health  are  eommon  to  all 
aireraft  maintenanee  organizations. 

A  seeond  observation  whieh  should  garner  the  attention  of  Air  Foree  leaders  was 
made  during  the  data  eolleetion  portion  of  this  analysis.  It  was  made  apparent  that 
eertain  elements  deseribed  by  leadership  as  measures  of  performanee  were  not  readily 
available  at  all  organizational  levels.  Aireraft  maintenanee  data  are  not  kept  in  a 
universal  information  management  system  whieh  eauses  diffieulty  in  retrieving  and 
performing  analysis  on  past  data.  Some  metries  are  not  used,  stored,  or  obtainable  at 
different  organizational  levels  due  to  inadequate  systems. 
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Recommendations  from  Analysis 

The  first  recommendation  is  in  reference  to  the  initial  finding  of  the  research.  It  is 
imperative  that  leadership  defines  what  it  considers  to  be  indicators  of  Overall  Balance, 
Sortie  Production,  and  Fleet  Health.  Without  consistency  in  these  topics,  maintenance 
managers  at  all  levels  and  across  organizations  are  dealt  with  making  their  own 
determinations  as  to  what  constitutes  each  one. 

A  second  recommendation  is  also  directed  toward  leadership  and  their  ability  to 
closely  evaluate  maintenance  data  collection  systems  used  Air  Force-wide.  Today's 
technology  is  capable  of  performing  significantly  greater  functions  than  in  the  past. 
Establishing  an  enterprise-wide  system  would  notably  enhance  communication  channels 
and  information  transfer  to  managers  and  the  warfighter.  An  investigation  should  be 
conducted  or  change  directed  to  the  establishment  of  this  type  of  system. 
Recommendations  for  Future  Research 

During  the  process  of  conducting  this  research,  numerous  opportunities  emerged 
for  possible  topics  which  would  advance  the  subject  of  this  study.  The  following 
paragraphs  present  areas  for  future  research  relating  to  organizational  structure  and  its 
influence  on  performance. 

Qualitative  Research.  A  second  half  to  this  research  involves  studying  the 
impact  to  those  items  considered  qualitative  in  nature.  As  described  in  the  CLR,  the 
intent  of  the  Air  Force-wide  reorganization  was  to  not  only  improve  upon  sortie 
production  and  fleet  health,  but  also  build  upon  the  core  competencies  within  each 
occupational  specialty.  As  with  many  situations,  certain  trade-offs  may  exist  between 
two  areas  of  considerable  importance.  Improvements  recognized  in  one  area  may  result 
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in  a  sacrifice  to  the  performance  of  another.  Future  researeh  should  focus  on  evaluating 
those  more  qualitative  managerial  related  aspects  in  an  attempt  to  ascertain  any  ehanges 
that  oecurred  since  the  reorganization. 

Performance  Metrics.  While  conducting  this  research,  it  was  discovered  that 
Fleet  Health  and  Sortie  Production  are  key  areas  of  importance  to  leadership,  yet  no 
single  metric  exists  to  measure  either  of  these  subjeets.  Researeh  should  be  conducted  in 
an  effort  to  aid  leadership  in  modeling  and  developing  metries  that  accurately  represent 
the  eontext  of  what  is  considered  Fleet  Health  and  Sortie  Production.  In  this  way,  a 
representation  of  aircraft  maintenance  performanee  eould  be  reviewed  and  managed. 

Logistics  Readiness  Functions.  Two  additional  major  changes  that  oeeurred 
during  the  recent  reorganization  were  the  ereation  of  the  Logistics  Readiness  Officer  and 
segregation  of  their  associated  functions  from  aircraft  maintenance.  Just  as  important  to 
understand  is  the  impact  that  the  reorganization  had  on  the  Logisties  Readiness  funetions. 
Researeh  in  this  area  could  be  performed  on  the  quantitative  metries  used  in  the  Logistics 
Readiness  career  field  or  various  qualitative  measurements  established  by  the  researcher. 
Summary 

This  chapter  culminates  the  extent  of  this  researeh  with  assoeiated  conclusions 
made  from  the  investigation  and  analysis  portions  previously  deseribed.  A  focus  was 
maintained  on  answering  the  overall  research  question  regarding  the  effectiveness  of 
aireraft  maintenance  following  the  most  recent  change  in  organizational  structure. 

Finally,  a  list  of  potential  future  researeh  topies  were  presented  in  an  effort  to  further 
advanee  the  subject  of  structural  change  and  its  impact  on  aircraft  maintenance 
performance. 
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Appendix  A  -  Primary  Maintenance  Metrics 
(as  described  in  AFI  21-101) 


Abort  (Total)  Rate  (AR),  A  unit’s  abort  rate  is  a  leading  indieator  of  both  aireraft 
reliability  and  quality  of  maintenanee  performed.  It  is  the  pereentage  of  missions  aborted 
in  the  air  and  on  the  ground.  An  abort  is  a  sortie  that  ends  prematurely  and  must  be  re- 
aeeomplished.  The  abort  rate  may  be  measured  separately  as  ground  or  air  aborts. 

Total  AR  (%)  =  Air  +  Ground  Aborts  x  100  /  Total  Sorties  Flown  +  Ground  Aborts 
Maintenance  aborts  are  those  sorties  ended  prematurely  on  the  ground  or  in  the  air 
eaused  by  system  failures/maintenanee  problems.  Maintenanee  abort  rates  ean  gauge  both 
aireraft  reliability  and  quality  of  maintenanee  performed.  Maintenanee  abort  rates  ean  be 
ealeulated  using  the  following  formulas. 

Maintenance  Air  AR  (%)  =  Air  Aborts  (Maintenance)  x  100  /  Total  Sorties  Flown 
Maintenance  Ground  AR  (%)  =  Ground  Aborts  (Maintenance)  x  100  /  Total  Sorties 
Flown  +  Ground  Aborts 

Break  Rate  (BR).  The  break  rate  is  a  leading,  flying-related  metric.  It  is  the  percentage 
of  aircraft  that  land  in  “Code-3”,  or  “Alpha-3”  for  Mobility  Air  Force  (MAF),  status 
(unable  to  complete  at  least  one  of  its  primary  missions).  This  metric  primarily  indicates 
aircraft  system  reliability.  It  may  also  reflect  the  quality  of  aircraft  maintenance 
performed.  If  Fix  Rates  (refer  to  paragraph  1. 1 0.3. 6.)  are  used  as  a  measurement  of 
maintainability,  the  Break  Rate  is  the  complementary  measurement  of  reliability.  For  true 
evaluation  of  equipment/system  reliability,  measurements  must  be  taken  at  the 
system/subsystem  level.  It  is  also  an  excellent  predictor  of  parts  demand.  Several 
indicators  that  follow  break  rate  are  Mission  Capable  (MC),  Total  Not  Mission  Capable 
for  Supply  (TNMCS),  Cannibalization  Rate  (CR)  and  Repeat/Recur  (R/R). 

BR  (%)  =  Number  of  Sorties  that  Land  “Code-3”  x  100  /  Total  Sorties  Flown 
Cannibalization  Rate  (CR).  The  CR  is  a  leading  indicator  that  reflects  the  number  of 
cannibalization  (CANN)  actions  (removal  of  a  serviceable  part  from  an  aircraft  or  engine 
to  replace  an  unserviceable  part  on  another  aircraft  or  engine  or  to  fill  an  RSP).  In  most 
cases,  a  cannibalization  action  takes  place  when  base  supply  cannot  deliver  the  part  when 
needed  and  mission  requirements  demand  the  aircraft  be  returned  to  an  MC  status.  The 
CR  is  the  number  of  cannibalization  actions  for  total  sorties  flown.  This  rate  includes  all 
aircraft- to -aircraft,  engine-to-aircraft,  and  aircraft/engine  to  RSP  cannibalization  actions. 
Since  supply  relies  on  the  back  shops  and  depot  for  replenishment,  this  indicator  can  also 
be  used,  in  part,  to  indicate  back  shop  and  depot  support. 

CR  (%)  =  Number  of  Aircraft  and  Engine  CANNs  x  100  /  Total  Sorties  Flown 
Deferred  (or  Delayed)  Discrepancy  (DD)  Rate  (DDR).  The  DDR  is  a  leading  indicator 
that  should  be  closely  evaluated  in  comparison  to  other  metrics.  This  rate  represents  the 
average  deferred  discrepancies  across  the  unit's  average  possessed  aircraft  fleet. 
Discrepancies  are  considered  deferred  when:  a)  they  are  discovered  and  the  decision  is 
made  to  defer  them,  b)  discrepancies  are  scheduled  with  a  start  date  greater  than  5  days 
after  the  discovery  date,  or  c)  discrepancies  are  awaiting  parts  with  a  valid  off  base 
requisition.  Delayed  discrepancies  may  be  Awaiting  Maintenance  (AWM)  or  Awaiting 
Parts  (AWP).  Although  minor  maintenance  actions  must  sometimes  be  deferred  or 
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delayed  to  a  more  opportune  time,  maintenance  should  try  to  keep  this  rate  as  low  as 
possible.  If  delayed  discrepancies  can’t  be  scheduled/combined  with  a  more  extensive 
maintenance  action,  maintenance  schedulers  should  routinely  schedule  their  aircraft  down 
for  a  day  when  required  to  work  deferred  discrepancies.  The  DDR  metric  measures 
AWM  +  AWP  rates,  though  individual  AWM  and  AWP  rates  can  and  should  also  be 
monitored. 

Total  DDR  (%)  =  Total  (Snapshot)  AWM  +  AWP  Discrepancies  /  Average  Aircraft 
Possessed 

AWM  DDR  (%)  =  Total  (Snapshot)  AMW  Discrepancies  /  Average  Aircraft  Possessed 
AWP  DDR  (%)  =  Total  (Snapshot)  AWP  Discrepancies  /  Average  Aircraft  Possessed 
Aircraft  Possession.  A  key  factor  in  metrics  involves  aircraft  “possession”.  The  Air 
Force  mandates  each  aircraft  will  always  be  owned  or  “possessed”  by  a  designated 
organization.  Possession  is  an  indicator  of  an  organization’s  or  aircraft  fleet’s  health. 
Aircraft  that  are  under  the  control  of  their  owning  base  are  possessed  by  that 
organization.  An  aircraft  that  flies  to  depot  for  maintenance/inspection  or  is  repaired  by  a 
depot  team  at  the  base  is  temporarily  possessed  by  depot.  In  calculating  the  various 
aircraft  maintenance  metrics,  possession  is  calculated  in  units  of  hours  normally  for 
specific  time  periods  (e.g.,  monthly,  annual,  etc.). 

Departure  (Logistics)  Reliability  (DR)  Rate  (DRR).  This  is  a  broader  leading  metric 
used  primarily  for  airlift  aircraft  that  may  show  a  composite  of  supply,  saturation  or 
maintenance  problems.  The  on-time  standard  for  departures  are  those  within  15  minutes 
of  the  daily  scheduled  departure  time.  The  metric  provides  the  commander  with  an 
objective  measure  of  the  health  of  the  air  mobility  system  and  reflects  the  percentage  of 
departures  that  are  on-time.  The  main  focus  of  the  departure  reliability  metric  is  to 
strengthen  the  air  mobility  system  through  accountability  for  process  improvement.  This 
metric  may  also  be  subdivided  into  other  categories  (e.g.,  worldwide  departure  or  en 
route). 

DRR  (%)  =  Number  of  Departures  -  Number  of  Logistics  Delays  x  100  /  Number  of 
Departures 

Fix  Rate  (FR).  The  FR  is  a  leading  indicator  showing  how  well  the  repair  process  is 
being  managed.  It  is  a  percentage  of  aircraft  landing  with  CAP  Code-3  or  4  pilot  reported 
discrepancies  (PRDs)  returned  to  flyable  status  in  a  certain  amount  of  time  (clock  hours). 
Problems  found  by  maintenance  after  the  aircraft  lands  (ground  found)  are  not  considered 
in  the  fix  time.  The  fix  time  stops  when  all  CAP  Code-3  or  4  PRDs  are  fixed  even  if  the 
aircraft  remains  NMC.  This  metric  is  an  excellent  tool  to  track  "dead  time"  in  aircraft 
repair  processes  because  it  measures  the  speed  of  repair  and  equipment  maintainability. 
The  common,  standard  interval  for  this  metric  is  12-hours.  However,  fighter  units 
typically  measure  fix  rate  at  shorter  intervals  (4  and/or  8  hours)  along  with  the  12-hour 
rate. 

FR  (%)  =  “Code-3”  Breaks  Fixed  Within  12  Hours  of  Landing  x  100  /  Total  “Code-3” 
Breaks 

Flying  Schedule  Effectiveness  (FSE)  Rate.  This  leading  indicator  is  a  measure  of  how 
well  the  unit  planned  and  executed  the  weekly  flying  schedule.  The  flying  scheduled 
developed  by  tail  number  is  the  baseline  upon  which  the  FSE  is  derived  by  comparing 
each  day’s  deviations.  Deviations  that  decrease  the  FSE  from  100%  include;  scheduled 
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sorties  not  flown  because  of  maintenance,  supply,  operations,  weather,  HHQ,  air  traffic 
control,  sympathy,  or  other  reasons;  scheduled  sorties  that  takeoff  more  than  30  minutes 
prior  to  scheduled  takeoff;  scheduled  sorties  that  takeoff  more  than  15  minutes  after  their 
scheduled  takeoff  time  (30  minutes  for  RC-135,  EC-135,  and  U-2  aircraft);  and  sorties 
that  are  added  to  the  schedule.  Disruptions  to  the  flying  schedule  can  cause  turmoil  on  the 
flight  line,  send  a  ripple  effect  throughout  other  agencies,  and  adversely  impact  scheduled 
maintenance  actions.  [Adjusted  Sorties  Scheduled  =  Total  Sorties 

Scheduled  -  Sorties  Cancelled  for  MonthlyAf  early  Utilization  (UTE)  Rate  Achievement  + 
Sorties  Added  for  End  of  Eiscal  Year  UTE  Close  Out].  Some  MAE  units  calculate  ESE 
using  the  formula  in  paragraph  1.10.3.7.2. 

FSE  (%)  =  Adjusted  Sorties  Scheduled  -  Chargeable  Deviations  x  100  /  Adjusted  Sorties 
Scheduled 

MAF  FSE  (%)  =  Sorties  Scheduled  -  Total  Deviations  x  100  /  Sorties  Scheduled 
Hangar  Queen  (HQ)  (Average)  Rate.  A  Hangar  Queen  is  an  aircraft  that  has  not  flown 
for  at  least  30  consecutive  days  in  their  possessed  status,  or  not  flown  within  10  days 
after  being  gained  from  depot  possession  (in  “D/B-Status”  codes).  Refer  to  Chapter  18 
for  HQ  categories/criteria.  This  indicator  is  used  to  evaluate  management  of  the  Hangar 
Queen  program  and  to  assist  units  with  problems  beyond  their  control.  The  HQ  rate 
captures  the  average  number  of  aircraft  hangar  queen  days  (all  categories)  for  a  specified 
reporting  period. 

HQ  (%)  =  Total  Acft  Days  in  all  HQ  Categories  (in  report  period)  x  100  /  Days  (in  report 
period) 

Home-Station  Logistics  Departure  Reliability  (HSLDR)  Rate.  This  is  a  leading  metric 
used  primarily  by  the  MAF  for  airlift  aircraft.  This  delineates  down  to  only  first-leg 
departures  of  unit-owned  aircraft  departing  home  station. 

HSLDR  Rate  (%)  =  #  of  HS  Departures  -  #  of  HS  Logistics  Delays  x  100  /  #  of  HS 
Departures 

Maintenance  Schedule  Effectiveness  (MSE).  This  is  a  leading  indicator  that  measures 
success  in  the  unit’s  ability  to  plan  and  complete  inspections  and  periodic  maintenance 
on-time  per  the  maintenance  plan.  Deviations  to  the  plan  are  recorded.  A  low  MSE  rate 
may  indicate  a  unit  is  experiencing  turbulence  on  the  flight  line  or  in  the  back  shops.  This 
indicator  is  primarily  used  as  feedback  to  maintenance  managers  on  the  success  and 
adherence  to  scheduled  maintenance  plans  and  actions. 

MSE  (%)  =  Number  of  Scheduled  Mx  Actions  Completed  On-Time  x  100  / 

Total  Number  of  Mx  Actions  Scheduled 

Mission  Capable  (MC)  Rate.  The  MC  rate  is  perhaps  the  best-known  yardstick  for 
measuring  a  unit’s  performance.  It  is  the  percentage  of  possessed  hours  (excluding 
aircraft  in  “B-Type”  possession  purpose  code/purpose  identifier  code  status:  BJ,  BK,  BE, 
BN,  BO,  BQ,  BR,  BT,  BU,  BW,  BX)  for  aircraft  that  are  EMC  or  PMC  for  specific 
measurement  periods  (e.g.,  monthly  or  annual).  This  metric  is  a  lagging  indicator  and 
represents  a  broad  composite  of  many  processes  and  metrics.  A  low  MC  rate  may 
indicate  a  unit  is  experiencing  many  hard  breaks,  parts  supportability  shortfalls  or 
workforce  management  issues.  Maintenance  managers  should  look  for  workers  deferring 
repairs  to  other  shifts,  inexperienced  workers,  lack  of  parts  from  supply,  poor  in-shop 
scheduling,  high  cannibalization  rates  or  training  deficiencies.  High  commitment  rates 
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may  also  contribute  to  a  lower  MC  rate.  The  key  is  to  focus  on  negative  trends  and 
identify  systemie,  underlying  eauses.  Further,  the  root  faetors  of  the  MC  rate  should  be 
measured,  evaluated  and  reported  through  the  use  of  the  TNMCM,  TNMCS  and  NMCB 
rates. 

MC  (%)  =  FMC  Hours  +  PMC  Hours  -  “B-Type”  Status  Hours  x  100  /  Possessed  Hours 
Total  Not  Mission  Capable  Maintenance  (TNMCM)  Rate.  Though  a  lagging 
indieator,  the  TNMCM  rate  is  perhaps  the  most  eommon  and  useful  metrie  for 
determining  if  maintenance  is  being  performed  quiekly  and  aeeurately.  It  is  the  average 
pereentage  of  possessed  aircraft  (calculated  monthly/annually)  that  are  unable  to  meet 
primary  assigned  missions  for  maintenanee  reasons  (exeluding  aircraft  in  “B-Type” 
possession  identifier  eode  status).  Any  aireraft  that  is  unable  to  meet  any  of  its  wartime 
missions  is  eonsidered  Not  Mission  Capable  (NMC).  The  TNMCM  is  the  amount  of  time 
aireraft  are  in  NMCM  plus  Not  Mission  Capable  Both  (NMCB)  status.  Maintenanee 
managers  should  look  for  a  relationship  between  other  metries  sueh  as  R/R,  BR  and  FR  to 
the  TNMCM  Rate.  A  strong  eorrelation  could  indicate  heavy  workloads  (e.g.,  people  are 
over  tasked),  poor  management,  training  problems  or  poor  maintenance  practiees.  The 
TNMCM  is  also  ealled  “out  for  maintenanee.” 

TNMCM  (%)  =  NMCM  Hrs  +  NMCB  Hrs  -  “B-Type”  Status  Hrs  x  100  /  Possessed 
Hours 

Total  Not  Mission  Capable  Supply  (TNMCS)  Rate.  Though  this  lagging  metric  may 
seem  a  “supply  responsibility”  beeause  it  is  prineipally  driven  by  availability  of  spare 
parts,  it  is  often  direetly  indieative  of  maintenanee  praetiees.  For  instanee,  maintenanee 
ean  keep  the  rate  lower  by  eonsolidating  feasible  eannibalization  aetions  to  as  few  aircraft 
as  practical.  This  monthly/annual  metric  is  the  average  pereentage  of  possessed  aireraft 
that  are  unable  to  meet  primary  missions  for  supply  reasons.  The  TNMCS  rate  is  the  time 
aireraft  are  in  NMCS  plus  NMCB  status.  TNMCS  is  based  on  the  number  of  airframes 
out  for  MICAP  parts  that  prevent  the  airframes  from  performing  their  mission  (NMCS  is 
not  the  number  of  parts  that  are  MICAP).  Maintenanee  managers  must  elosely  monitor 
the  relationship  between  the  Cannibalization  Rate  (CR)  and  TNMCS.  TNMCS  is  also 
ealled  "out  for  supply." 

TNMCS  (%)  =  NMCS  Hrs  +  NMCB  Hrs  -  “B-Type”  Status  Hrs  x  100  /  Possessed  Hours 
Primary  Aerospace  Vehicle  Authorized  (PAA)  vs.  Possessed  (P/P)  Rate.  PAA  are 
those  aireraft  authorized  for  a  unit  to  perform  their  operational  mission(s).  It  forms  the 
basis  to  alloeate  operating  resourees  to  inelude  manpower,  support  equipment,  and  flying 
hour  funds.  This  metrie  shows  a  eomparison  of  the  unit’s  PAA  versus  average  possessed 
aireraft  for  a  particular  time  period.  It  identifies  units  below  PAA  so  MAJCOM/  HAF  ean 
assist  in  realloeating  resourees  to  support  eontingeney  taskings  or  to  reduee  flying  hour 
requirements. 

P/P  (%)  =  Average  Number  of  Possessed  Aircraft  x  100  /  Total  Unit  Aircraft  PAA 
Personnel  Availability  (PA),  Personnel  availability  simply  provides  a  measure  of 
manning  status.  It  eompares  the  number  of  personnel  authorized  to  the  number  of 
personnel  available.  A  maintenanee  manager  may  find  it  useful  to  review  data  based  on 
skill  level.  In  whieh  ease,  compare  the  personnel  authorized  to  the  number  of  personnel 
holding  a  speeifie  skill  level.  The  number  authorized  is  based  on  the  Unit  Manning 
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Document.  The  number  available  ineludes  only  those  available  for  duty,  whieh  exeludes 
those  who  are  reassigned,  on  leave,  TDY,  ete. 

PA  (%)  =  Total  Number  of  Personnel  Available  x  100  /  Total  Number  of  Personnel 
Authorized 

Phase  Flow  (PF)  Average.  A  phase  time-distribution  interval  (TDI)  is  a  produet  that 
shows  hours  remaining  until  the  next  phase  on  eaeh  aireraft  possessed  by  a  unit.  This 
leading  metrie  measures  the  average  phase  time  remaining  on  the  fleet.  It  should  be 
approximately  half  the  inspeetion  interval  and  should  appear  as  a  diagonal  line  when  the 
fleet  PF  average  is  portrayed  graphieally  in  a  TDI  (e.g.,  “seatter  gram”).  However,  a  unit 
may  have  good  reasons  to  manage  its  phase  flow  so  the  data  points  define  a  pattern  other 
than  a  diagonal  line.  For  example,  in  preparation  for  a  long-distanee  overseas 
deployment,  a  unit  may  need  to  build  up  the  average  phase  time  remaining  on  its  fleet, 
beeause  phase  eapability  may  be  limited  for  a  short  time.  Beware  of  gaps  or  groupings, 
espeeially  on  aireraft  with  less  than  half  the  time  remaining  to  phase. 

PF  =  Total  Hours  of  All  Possessed  Aireraft  Until  Next  Phase  /  Total  Possessed  Aireraft 
Assigned 

Repair  Cycle  Processing  (RCP)  Total  Time/Rate.  Though  primarily  considered  a 
“supply-related  metric,”  this  indicator  can  be  an  excellent  local  management  tool.  It  is  the 
average  time  expressed  in  days  that  an  unserviceable  asset  spends  in  the  repair  cycle  at  a 
unit.  This  indicator  is  for  repairable  aircraft  parts  only;  it  does  not  include  engines  or 
support  equipment.  The  clock  begins  when  the  replacement  part  is  issued  to  the  flight  line 
and  ends  when  the  serviceable  asset  is  returned  from  the  repair  facility  to  the  parts  store 
for  reissue.  To  improve  the  process  of  repairing  parts,  the  different  steps  in  that  process 
must  be  measured. 

RCP  (%)  =  (Pre-Mx  +  Repair  +  Post-Mx  Days)  -  AWP  Days  x  100  /  Number  of  Items 
Turned  In 

Repeat/Recurring  (R/R)  Discrepancy  Rate.  This  metric  is  a  leading  indicator  and 
perhaps  the  most  important  and  accurate  measure  of  the  unit's  maintenance  quality.  It  is 
the  average  number  of  repeat  and  recur  system  malfunctions  compared  to  the  total 
number  of  aircrew  discrepancies.  A  repeat  discrepancy  is  when  the  same  malfunction 
occurs  in  a  system/subsystem  on  the  next  sortie/sortie  attempt  after  the  discrepancy 
originally  occurred  and  was  cleared  by  maintenance  (including  CNDs/no-defect-noted, 
etc).  A  recurring  discrepancy  is  when  the  same  system/subsystem  malfunction  occurs  on 
the  2nd  thru  4th  flights/attempted  flights  after  the  original  flight  in  which  the  malfunction 
occurred  and  was  cleared  by  maintenance  (including  CNDs/no-defect-noted,  etc).  A  high 
R/R  rate  may  indicate  lack  of  thorough  troubleshooting;  inordinate  pressure  to  commit 
aircraft  to  the  flying  schedule  for  subsequent  sorties;  or  a  lack  of  experienced,  qualified 
or  trained  technicians.  The  more  complex  the  weapon  system  and  the  greater  the 
operations  tempo,  the  more  susceptible  a  unit  is  for  repeat  or  recurring  discrepancies. 
Examine  each  R/R  discrepancy  and  seek  root  causes  and  lasting  fixes.  The  goal  should  be 
to  keep  all  repeat  and  recurring  discrepancies  to  a  minimum. 

R/R  (%)  =  Total  Repeats  +  Total  Recurs  x  100  /  Total  Pilot  Reported  Discrepancies 
Upgrade  Training  (UT)  Rate.  This  metric  reflects  the  percentage  of  technicians  in 
upgrade  training.  The  goal  should  be  to  keep  the  combined  total  less  than  40  percent 
because  the  higher  the  number,  the  greater  the  training  burden.  Training  should  be  given 
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high  priority,  as  the  number  of  personnel  in  training  (and  more  importantly,  the  quality  of 
the  maintenance  training  program)  invariably  affects  other  aircraft  metrics  (e.g.,  R/R  or 
FR)  in  ways  that  may  not  be  immediately  obvious. 

UT  (%)  =  Number  of  Technicians  in  Upgrade  Training  x  100  /  Total  Number  of 
Technicians 

Utilization  (UTE)  Rate.  The  UTE  rate  is  a  leading  indicator,  but  serves  as  a  yardstick  for 
how  well  the  maintenance  organization  supports  the  unit’s  mission.  The  UTE  rate  is  the 
average  number  of  sorties  or  hours  flown  per  primary  aerospace  vehicle  inventory  (PAI) 
aircraft  per  month.  This  measurement  is  primarily  used  by  operations  in  planning  the 
unit's  flying  hour  program.  Maintenance  uses  this  measurement  to  show  usage  of 
assigned  aircraft.  Since  UTE  rates  are  used  for  planning,  actual  UTE  rates  (computed  at 
the  end  of  the  month)  are  used  to  evaluate  the  unit's  monthly  accomplishment  against  the 
annual  plan.  Typically,  CAE  units  measure  the  sortie  UTE  rate,  while  MAE  units  measure 
the  hourly  UTE  rate  to  more  accurately  measure  the  combined  performance  of  operations 
and  maintenance. 

UTE  Rate  =  Sorties  (or  hours)  Elown  per  Month  /  PAI  Aircraft  per  Month 
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Appendix  B  -  Previous  Research  Variables 


Diener&  Hood 
(1980) 

GUiUand(1990) 

Jung  (1991) 

Davis  &  Walker 
(1992) 

Gray  &  Ranalli 
(1993) 

Stetz  (1999) 

Commenator 

(2001) 

Variable 

61,  9  D 

51,  8  D 

25  1,  3  D 

81,  1  D 

91, 2D 

171,  2D 

91,  lOD 

Air  Abort  /  Rate 

1/ 

I 

1/ 

Ground  Abort  /  Rate 

D 

D 

1/1 

I 

I 

1/ 

Avg  MMH  to  return  AC  to  FMC 

D 

Awaiting  Maintenance 

1 

Awaiting  Parts 

I 

Base  Self-sufficiency 

1 

Breaks  /  Rate 

I/l 

1/ 

1/ 

Cancels  /  Rate 

I/l 

1/ 

/I 

CANN  /  Rate 

1/ 

1/1 

1/ 

/I 

1/ 

Delay  Discrepancies  /  Rate 

1 

/I 

Enroute  Reliability 

D 

Fix  (4/8/12) /Rate 

I/l 

1/ 

D/D/D 

FMC 

D 

I 

Home  Station  Reliability 

D 

Hourly  Utilization 

I 

I 

Hours  Albcated 

I 

Hours  Fbwn 

1 

Hours  Flown  /  Hours  Allocated 

1 

Labor  Rate 

D 

Late  take-off/  Rate 

1 

/I 

1/ 

MC 

D 

D 

D 

D 

D 

Mean  Skill  Level 

I 

MHr  Expended 

I 

MHr/Sortie 

I 

1 

MMH  for  400-hr  Phase  Insp 

D 

Mx  Personnell  Assigned 

1 

Mx  Planning  Efectiveness 

I 

Mx  Scheduling  Effectiveness 

D 

D 

MxMhr/FHr 

D 

D 

I 

1 

I 

D 

D 

NMC 

I 

1 

NMCB 

I 

1 

NMCM 

D 

I 

1 

D 

I 

NMCS 

I 

1 

I 

Personnel  Assigned  vs.  Authorized 

1 

Personnel  Authourized  /  Aircraft 

I 

PMC 

I 

PMCB 

I 

PMCM 

I 

PMCS 

I 

Possessed  Aircraft 

I 

I 

I 

I 

I 

Possessed  Hours 

I 

Recur 

I 

D 

Repeat 

D 

D 

I 

D 

RepeaLRecur 

D 

Scheduling  Efectiveness 

D 

I 

I 

D 

Sortie  Duration 

1 

I 

Sortie  Utilization 

I 

I 

Sorties  Attempted 

1 

Sorties  Flown 

1 

Sorties  Scheduled 

1 

TNMCM 

D 

D 

TNMCS 

D 

I 

Train  Reliability 

D 

Utilization 

1 

I 

I  =  Independent  D  =  Dependent 
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Appendix  C  -  Maintenance  Metrics  Comparison  Table 


Maintenance  Metrics 

Source 

Variable 

Air  Force  Instructions 

Monthly  Reports 

MAJCOM  Briefings 

CLR 

APA 

X 

X 

AR 

X 

X 

X 

AWM 

X 

AWP 

X 

BR 

X 

X 

X 

X 

CR 

X 

X 

X 

X 

DD 

X 

X 

X 

X 

DEV 

X 

X 

DOP 

X 

X 

DR 

X 

X 

X 

FHA 

FHP 

X 

FR 

X 

X 

X 

X 

FSA 

FSE 

X 

X 

X 

HQ 

X 

MC 

X 

X 

X 

MICAP 

X 

MMH 

MSE 

X 

X 

X 

P/P 

X 

PA 

X 

PF 

X 

X 

R/R 

X 

X 

X 

RC 

X 

RCP 

X 

X 

RP 

X 

TCTO  Backlog 

X 

TDI 

X 

TNMCM 

X 

X 

X 

X 

TNMCS 

X 

X 

X 

UT 

X 

UTE 

X 

X 

X 
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Appendix  D  -  Data  Tables 


20FW  Data: 


I  OVERALL  BALANCE  |  SORTIE  P  ROD  UCT  ION  |  FLEET  HEALTH  PERFORMANCE  | 
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27  FW  Data: 


OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH  PERFORMANCE 

D  ate 

DEV 

FHA 

FR 

AR 

BR 

CR 

RC 

RP 

DD 

R/R 

RCP 

M  M  H 

TNMCM 

M  C 

F16 

14.6 

reiglil 

«gEM 

»iaEM 

24.1 

6.8 

6.2 

8.0 

6.2 

3.7 

32 

66.1 

4.3 

6.9 

3.4 

20.0 

F16 

1S.3 

giEOil 

miiM 

6.5 

75.0 

5.0 

8.5 

8.6 

1.3 

3.1 

64.5 

6.2 

4.4 

4.4 

11.6 

814 

F16 

■wga 

17.9 

mytuM 

■WZM 

■gif 

■lif 

■>*■ 

6.3 

7.7 

6.4 

9.0 

2.9 

3.1 

64.5 

6.9 

6.1 

5.1 

6.1 

79.7 

F16 

■»iga 

15.0 

■iifclCT 

■sTiWa 

■*!<■ 

»>*■ 

6.0 

■fiTM 

5.1 

8.6 

8.8 

2.2 

3.0 

64.5 

6.3 

5.2 

3.3 

6.4 

77.1 

F16 

■tsngtTii 

1B.0 

■i6T« 

»ggM 

Kifl 

6.6 

■fiTM 

5.6 

6.1 

9.9 

3.5 

2.9 

5.4 

6.3 

0.0 

6.1 

77.9 

F16 

■»iga 

■glgiTil 

14.6 

■sriWM 

mnnm 

■MM 

■JliM 

66 

■gif 

5.7 

8.0 

8.2 

2.5 

32 

616 

5.0 

5.8 

4.0 

6.1 

F16 

■Mga 

15.8 

■itwra 

■»«tl 

■g»T« 

■TJM 

■JilM 

6.7 

■ATM 

6.7 

8.4 

9.4 

4.3 

1.9 

5.0 

6.3 

4.8 

47.5 

6.9 

78.4 

F16 

■»iga 

MTOiTtl 

12.5 

ItTifa 

■/»T« 

■T*M 

■JilM 

V2 

■giTM 

5.9 

5.9 

11.2 

4.7 

2.7 

■giTM 

4.8 

7.4 

5.7 

6.8 

F16 

■»iga 

15.8 

1510.6 

600.0 

mi3m 

■BIM 

mum 

66 

717 

5.1 

8.3 

9.3 

2.7 

2.3 

613 

52 

4.9 

4.4 

6.1 

F16 

27FW 

Jun-OO 

115 

■gtf 

■Bf 

■ZIM 

6.8 

75.4 

7.0 

6.1 

9.9 

4.1 

2.0 

3.5 

6.1 

6.9 

6.6 

F16 

27FW 

Jul-00 

14.8 

■WZM 

■/>T« 

■BgM 

MM 

6.9 

74.2 

6..8 

8.3 

6.8 

4.3 

4.9 

■EltM 

2.5 

9.3 

5.2 

6.3 

72.4 

F16 

QIgQg] 

■awaii 

mwifm 

■g{f« 

■TgTM 

■EKM 

7.2 

6.0 

14.0 

5.6 

3.1 

Ktta 

4.3 

8.7 

3.7 

6.0 

F16 

■Mga 

14.0 

■iMia 

■rzrara 

■i6T« 

■TgbM 

■TilM 

6.5 

72.2 

6.1 

6.0 

6.3 

4.8 

5.4 

■fif 

4.8 

6.2 

5.6 

31.9 

6.9 

F16 

TOga 

■etsailil 

15.3 

g^gaei 

gjgRCT 

«!if 

■iSIM 

msim 

6.5 

7.5 

6.0 

6.9 

3.2 

4.9 

■Ef 

52 

8.1 

4.9 

14.9 

F16 

^ga 

IJI.Milil 

14.5 

■SBIiCT 

■5BBIIM 

«gf 

■igf 

■Ef 

6.8 

77.8 

6.3 

6.4 

6.9 

5.4 

2.1 

■gif 

4.5 

7.5 

6.7 

6.2 

74.5 

F16 

TOga 

•e.2 

gggg?! 

57.8 

■Ef 

■Ef 

6.2 

75.4 

6.1 

9.8 

6.6 

4.7 

2.7 

512 

3.9 

7.4 

7.5 

6.1 

74.8 

F16 

■»iga 

■tsngffi 

119 

■BJEM 

■ZliM 

6.4 

IjiJ^ 

7.0 

6.2 

6.4 

3.4 

1.5 

3.3 

4.9 

5.1 

6.0 

75.5 

F16 

■»iga 

110 

■ffgaii'a 

■twani 

■T{>M 

■EfcM 

6.0 

810 

5.1 

8.2 

6.8 

3.1 

0.9 

■grM 

3.9 

4.0 

3.2 

6.9 

F16 

■»iga 

■BETgtTI 

14.5 

mfjzvm 

■iftgM 

■TigM 

■ElM 

6.4 

7.4 

9.0 

11.1 

4.5 

4.3 

2.9 

8.7 

3.4 

6.8 

F16 

■wga 

■angffi 

110 

■ygara 

«!Er« 

■giiiM 

■BTM 

■BTM 

212 

■AliM 

5.2 

7.9 

6.4 

3.6 

4.6 

■gfeM 

3.0 

8.2 

6.7 

66 

F16 

■»iga 

■BEWtTI 

10.5 

■gilM 

MM 

■If 

■BliM 

■ATM 

4.5 

6.6 

6.3 

2.9 

2.0 

3.1 

4.9 

6.5 

6.4 

6.8 

810 

F16 

27FW 

Jun-01 

12.6 

■ittelll 

■^T« 

■If 

■Jif 

■ETM 

■gsTM 

4.7 

7.5 

7.3 

4.0 

3.3 

■fgM 

2.9 

7.3 

5.0 

31.7 

6.0 

74.9 

F16 

27FW 

Jul-01 

119 

■5E6CT 

■tTiMTil 

■gar« 

maim 

6.5 

67.5 

6.4 

7.9 

6.1 

2.2 

3.1 

■fgM 

3.5 

5.3 

3.7 

14.7 

F16 

BIBBtl 

119 

■isTtMTil 

■igf 

■If 

■TilM 

75.5 

5.9 

8.2 

8.6 

4.9 

5.5 

■fgM 

3.8 

6.4 

4.5 

6.5 

F16 

^ga 

8.1 

g^gpl 

»!>■ 

Kua 

211 

73.5 

5.5 

T1.6 

6.3 

5.5 

3.0 

616 

72 

8.5 

2.8 

6.2 

710 

F16 

■»iga 

8.6 

■iwarii 

■Bf 

■ElM 

6.6 

79.7 

7.4 

T1.2 

8.9 

3.3 

1.8 

7.3 

5.1 

2.8 

11.4 

F16 

■aiga 

Isj^g 

8.5 

1401.6 

96.0 

■iif 

■If 

■JiliM 

6.3 

78.9 

6.6 

6.4 

6.8 

3.0 

1.4 

63.4 

7.0 

4.5 

2.6 

11.5 

F16 

^ga 

4.3 

•616.2 

160.0 

85.6 

■gf 

■gf 

6.8 

85.7 

5.2 

T1.2 

8.4 

4.4 

1.8 

64.1 

214 

6.2 

3.2 

7.4 

F16 

TOga 

■gjgllM 

3.7 

■Ef 

■Ef 

6.1 

4.6 

8.4 

6.6 

3.5 

1.9 

64.4 

6.7 

5.4 

2.7 

9.3 

F16 

^ga 

4.7 

gsBRia 

■ngtii 

■Ef 

■gf 

6.7 

HE! 

5.6 

6.3 

6.0 

4.3 

6.8 

7.7 

2.6 

6.0 

F16 

■Mga 

■angfti 

7.5 

611.5 

977.0 

■a!f 

■Ef 

■WM 

14.6 

77.1 

5.8 

6.4 

6.7 

2.5 

4.3 

■gilM 

116 

6.8 

2.6 

9.7 

F16 

■»iga 

6.6 

■gif 

■Tif 

Kia 

96 

818 

4.8 

9.9 

9.7 

4.3 

3.0 

■fgM 

9.3 

7.3 

2.6 

5.6 

F16 

■Mga 

5.6 

■ffftTil 

■ggiw 

■Bf 

6.2 

146 

Ijljlll 

7.3 

9.5 

7.2 

4.1 

3.3 

618 

6.5 

7.5 

2.1 

8.1 

F16 

27FW 

Jul-03 

6.3 

694.9 

654.0 

«»■ 

■TgftM 

6.5 

77.9 

6.3 

6.9 

9.6 

4.3 

2.4 

115 

6.7 

2.3 

9.4 

F16 

7.0 

6.5 

85.7 

5.8 

9.2 

9.6 

2.6 

1.7 

9.4 

4.3 

2.2 

8.1 

F16 

3.2 

79.4 

6.7 

4.7 

T1.5 

14.4 

4.0 

2.1 

7.8 

6.1 

2.8 

7.5 

F16 

5.8 

1759.0 

675.0 

211 

6.7 

6.0 

9.2 

3.1 

2.8 

2.9 

5.9 

2.6 

9.5 

F16 

8.0 

6.1 

6.7 

7.7 

9.1 

2.3 

2.7 

12 

5.0 

3.3 

8.8 

F16 

9.1 

6.7 

8.2 

6.2 

6.9 

3.1 

2.4 

3.6 

5.5 

4.2 

9.1 

F16 

7.5 

658.5 

1147.0 

6.1 

72.3 

7.5 

6.4 

8.8 

3.6 

2.7 

3.9 

6.3 

4.0 

31.4 

7.4 

F16 

9.4 

6.0 

73.0 

7.2 

6.4 

6.0 

3.9 

2.0 

22 

5.9 

8.4 

44.9 

11.4 

F16 

5.2 

77.3 

5.7 

9.6 

8.7 

3.8 

3.4 

2.3 

7.2 

4.5 

6.7 

F16 

EBSI 

5.3 

6.1 

77.4 

6.2 

8.6 

7.2 

1.9 

1.4 

17 

3.3 

5.0 

8.4 

F16 

9.0 

6.1 

817 

5.4 

8.6 

5.4 

2.3 

1.4 

13 

3.7 

4.3 

9.9 

F16 

27FW 

Jun-04 

6.3 

77.6 

77.6 

6.1 

6.4 

7.1 

3.3 

3.5 

2.2 

6.8 

4.5 

6.7 

814 

F16 

27FW 

Jul-04 

5.9 

1117.2 

865.0 

6.6 

14.4 

6.4 

8.4 

6.9 

3.8 

1.9 

3.4 

5.8 

4.4 

8.9 

F16 

4.8 

74.5 

6.1 

77.3 

5.4 

8.6 

7.4 

2.7 

2.9 

2.7 

5.6 

4.3 

7.3 

F16 

7.4 

■u 

119 

8.3 

6.0 

9.7 

3.2 

22 

2.3 

5.4 

4.0 

7.5 

87.7 
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388FW  Data: 


OVERALL  BALANCE 

SORTIE  PRODUCTION 

FLEET  HEALTH  PERFORMANCE 

FR 

BR 

CR 

RC 

RP 

DD 

F16 
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•0.6 

■HCTl 

■igRIil 

75.8 

ref 

ref 

15.7 

MW 

3.9 
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11 

12 
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ref 

6.6 

11.0 

12.9 
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11 

16 
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15 
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ref 
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810 
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ref 
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Appendix  E  -  Normality  Test  Results 


20FW: 


1  Shapiro-Wilk  Normality  Test  | 

20FW 

1  Group  1 

Result 

1  1 

1  Post  1 

Variable 

W 

P 

Null 

Distribution 
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P 

Null 

Distribution 
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0  B 

E  L 
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A  N 
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0.965088 
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HUTE 
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AR 
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0.978828 
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Normal 
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BR 

0.972452 

0.7276 

Accept 

Normal 

0.947225 
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Accept 

Normal 
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CR 

0.927932 
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Accept 

Normal 
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Accept 

Normal 

Normal 

RC 

0.905466 

0.0282 

Reject 

Non-Normal 

0.814883 
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Reject 

Non-Normal 

Non-Normal 

RP 

0.913399 
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Reject 

Non-Normal 
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Accept 
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E 

E 

H 
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Reject 
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Accept 
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Accept 

Normal 
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Accept 

Normal 
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MC 
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Accept 

Normal 

0.926921 

Accept 

Normal 

Normal 

27FW: 


1  Shapiro -Wilk  N o rmality  Test  | 

27FW 

1  Group  1 

Result 

1  1 

1  Post  1 

Variable 

W 

P 

Null 

Distribution 

W 

P 

Null 

Distribution 

Overall 

DEV 

0.912840 

0.0407 
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Non-Normal 
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0.6804 
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Accept 
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388FW: 


1  Shapiro-Wilk  Normality  Test  | 

388FW 

1  Group  1 

Result 

1  1 

1  Post  1 

Variable 

W 

P 

Null 

Distribution 

W 

P 

Null 

Distribution 

Overall 

0  B 

R  A 

A  N 

DEV 

0.940671 

0.1688 

Accept 

Normal 

0.944606 

0.2064 

Accept 

Normal 

Normal 

FHA 

0.910630 

0.0364 

Reject 

Non-Normal 

0.983816 

0.9545 

Accept 

Normal 

Non-Normal 

SFA 

0.961855 

0.4768 

Accept 

Normal 

0.969290 

0.6495 

Accept 

Normal 

Normal 

FSE 

0.915078 

0.0455 

Reject 

Non-Normal 

0.873272 

0.0061 

Reject 

Non-Normal 

Non-Normal 

MSE 

0.873397 
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Reject 

Non-Normal 
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0.0065 
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Non-Normal 

Non-Normal 

HUTE 
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0.4375 

Accept 
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Accept 

Normal 
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SUTE 

0.974047 

0.7664 

Accept 

Normal 
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Accept 

Normal 

Normal 
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S  0 
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R  U 

1  T 

0 

N 

FR 

0.980822 

0.9105 

Accept 

Normal 

0.977337 

0.8422 

Accept 

Normal 

Normal 

AR 

0.924230 

0.0725 

Accept 

Normal 

0.806852 

0.0004 

Reject 

Non-Normal 

Non-Normal 

BR 

0.960430 

0.4471 

Accept 

Normal 

0.945901 

0.2205 

Accept 

Normal 

Normal 

CR 

0.955121 

0.3484 

Accept 

Normal 

0.903589 

0.0257 

Reject 

Non-Normal 

Non-Normal 

RC 

0.907609 

0.0313 

Reject 

Non-Normal 

0.921948 

0.0645 

Accept 

Normal 

Non-Normal 

RP 

0.958118 

0.4018 

Accept 

Normal 

0.840451 

0.0015 

Reject 

Non-Normal 

Non-Normal 

H 

F 

T 

T 

H 

APA 

0.925407 

0.0770 

Accept 

Normal 

0.939966 

0.1628 

Accept 

Normal 

Normal 

DD 

0.970137 

0.6704 

Accept 

Normal 

0.853270 

0.0027 

Reject 

Non-Normal 

Non-Normal 

R/R 

0.942167 

0.1823 

Accept 

Normal 

0.928142 

0.0886 

Accept 

Normal 

Normal 

RCP 

0.916061 

0.0478 

Reject 

Non-Normal 

0.818651 

0.0006 

Reject 

Non-Normal 

Non-Normal 

MMH 

0.936625 

0.1371 

Accept 

Normal 

0.927948 

0.0877 

Accept 

Normal 

Normal 

TNMCM 

0.967875 

0.6149 

Accept 

Normal 

0.966675 

0.5860 

Accept 

Normal 

Normal 

MC 

0.971932 

0.7148 

Accept 

Normal 

0.974273 

0.7718 

Accept 

Normal 

Normal 

22ARW; 


1  Shapiro-Wilk  Normality  Test  | 

22ARW 

1  Group  1 

Result 

1  1 

1  Post  1 

Variable 

W 

P 

Null 

Distribution 

W 

P 

Null 

Distribution 

Overall 

O  B 

V  A 

E  L 

R  A 

A  N 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

0.936274 

0.1347 

Accept 

Normal 

0.779853 

0.0001 

Reject 

Non-Normal 

Non-Normal 

SFA 

0.939085 

0.1556 

Accept 

Normal 

0.850698 

0.0023 

Reject 

Non-Normal 

Non-Normal 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

0.903778 

0.0259 

Reject 

Non-Normal 

0.938117 

0.1481 

Accept 

Normal 

Non-Normal 

HUTE 

0.986540 

0.9806 

Accept 

Normal 

0.956821 

0.3779 

Accept 

Normal 

Normal 

SUTE 

0.983170 

0.9463 

Accept 

Normal 

0.951354 

0.2898 

Accept 

Normal 

Normal 

R 

S  0 

O  D 

R  U 

T  C 

1  T 

E  1 

N 

FR 

0.954248 

0.3340 

Accept 

Normal 

0.969976 

0.6664 

Accept 

Normal 

Normal 

AR 

0.940185 

0.1647 

Accept 

Normal 

0.859810 

0.0033 

Reject 

Non-Normal 

Non-Normal 

BR 

0.965639 

0.5615 

Accept 

Normal 

0.968743 

0.6360 

Accept 

Normal 

Normal 

CR 

0.967194 

0.5984 

Accept 

Normal 

0.927199 

0.0844 

Accept 

Normal 

Normal 

RC 

0.895015 

0.0169 

Reject 

Non-Normal 

0.978298 

0.8626 

Accept 

Normal 

Non-Normal 

RP 

0.957143 

0.3838 

Accept 

Normal 

0.965236 

0.5522 

Accept 

Normal 

Normal 

H 

E 

A 

E 

E 

T 

H 

APA 

0.953666 

0.3247 

Accept 

Normal 

0.954861 

0.3441 

Accept 

Normal 

Normal 

DD 

0.952290 

0.3035 

Accept 

Normal 

0.973175 

0.7453 

Accept 

Normal 

Normal 

R/R 

0.870152 

0.0053 

Reject 

Non-Normal 

0.976085 

0.8143 

Accept 

Normal 

Non-Normal 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

0.927672 

0.0865 

Accept 

Normal 

0.958241 

0.4041 

Accept 

Normal 

Normal 

TNMCM 

0.919802 

0.0578 

Accept 

Normal 

0.913283 

0.0416 

Reject 

Non-Normal 

Non-Normal 

MC 

0.894688 

0.0166 

Reject 

Non-Normal 

0.932991 

0.1137 

Accept 

Normal 

Non-Normal 
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92ARW; 


1  Shapiro-Wilk  N o rmality  Test  | 

92ARW 

1  Group  1 

Result 

1  1 

1  Post  1 

Variable 

W 

P 

Null 

Distribution 

W 

P 

Null 

Distribution 

Overall 

O  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

0.959219 

0.4229 

Accept 

Normal 

0.921645 

0.0635 

Accept 

Normal 

Normal 

SFA 

0.962302 

0.4864 

Accept 

Normal 

0.936933 

0.1393 

Accept 

Normal 

Normal 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

HUTE 

0.958413 

0.4074 

Accept 

Normal 

0.931716 

0.1065 

Accept 

Normal 

Normal 

SUTE 

0.953991 

0.3298 

Accept 

Normal 

0.935400 

0.1288 

Accept 

Normal 

Normal 

S  O 

O  D 

R  U 

T  C 

1  T 

E  1 

O 

FR 

0.947981 

0.2449 

Accept 

Normal 

0.940160 

0.1645 

Accept 

Normal 

Normal 

AR 

0.945883 

0.2203 

Accept 

Normal 

0.733543 

0.0001 

Reject 

Non-Normal 

Non-Normal 

BR 

0.966650 

0.5854 

Accept 

Normal 

0.970120 

0.6700 

Accept 

Normal 

Normal 

CR 

0.975932 

0.8108 

Accept 

Normal 

0.746676 

0.0001 

Reject 

Non-Normal 

Non-Normal 

RC 

0.962690 

0.4948 

Accept 

Normal 

0.954400 

0.3365 

Accept 

Normal 

Normal 

RP 

0.938048 

0.1476 

Accept 

Normal 

0.975087 

0.7912 

Accept 

Normal 

Normal 

E 

A 

E 

E 

T 

T 

APA 

0.929300 

0.0940 

Accept 

Normal 

0.847630 

0.0020 

Reject 

Non-Normal 

Non-Normal 

DD 

0.961922 

0.4783 

Accept 

Normal 

0.800829 

0.0003 

Reject 

Non-Normal 

Non-Normal 

R/R 

0.973148 

0.7446 

Accept 

Normal 

0.967777 

0.6125 

Accept 

Normal 

Normal 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

0.914168 

0.0435 

Reject 

Non-Normal 

0.913779 

0.0426 

Reject 

Non-Normal 

Non-Normal 

TNMCM 

0.952845 

0.3119 

Accept 

Normal 

0.937783 

0.1456 

Accept 

Normal 

Normal 

MC 

0.707459 

0.0001 

Reject 

Non-Normal 

0.941364 

0.1749 

Accept 

Normal 

Non-Normal 

319ARW: 


1  Shapiro-Wilk  Normality  Test  | 

319ARW 

1  Group  1 

Result 

1  1 

1  Post  1 

Variable 

W 

P 

Null 

Distribution 

W 

P 

Null 

Distribution 

Overall 

O  B 

V  A 

E  L 

R  A 

A  N 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

0.958192 

0.4032 

Accept 

Normal 

0.916736 

0.0495 

Reject 

Non-Normal 

Non-Norma! 

SFA 

0.959329 

0.4251 

Accept 

Normal 

0.968168 

0.6220 

Accept 

Normal 

Normal 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

0.334861 

0.0001 

Reject 

Non-Normal 

0.924027 

0.0717 

Accept 

Normal 

Non-Normal 

HUTE 

0.966876 

0.5908 

Accept 

Normal 

0.967081 

0.5957 

Accept 

Normal 

Normal 

SUTE 

0.974944 

0.7878 

Accept 

Normal 

0.934129 

0.1206 

Accept 

Normal 

Normal 

R 

S  0 

0  D 

R  U 

1  T 

E  1 

N 

FR 

0.956883 

0.3791 

Accept 

Normal 

0.979228 

0.8812 

Accept 

Normal 

Normal 

AR 

0.872222 

0.0058 

Reject 

Non-Normal 

0.692586 

0.0001 

Reject 

Non-Normal 

Non-Normal 

BR 

0.949301 

0.2617 

Accept 

Normal 

0.940641 

0.1686 

Accept 

Normal 

Normal 

CR 

0.941368 

0.1750 

Accept 

Normal 

0.891778 

0.0145 

Reject 

Non-Normal 

Non-Normal 

RC 

0.709749 

0.0001 

Reject 

Non-Normal 

0.965172 

0.5507 

Accept 

Normal 

Non-Normal 

RP 

0.831342 

0.0010 

Reject 

Non-Normal 

0.821627 

0.0007 

Reject 

Non-Normal 

Non-Normal 

H 

E 

A 

E 

E 

T 

H 

APA 

0.897084 

0.0187 

Reject 

Non-Normal 

0.866658 

0.0045 

Reject 

Non-Normal 

Non-Normal 

DD 

0.979372 

0.8840 

Accept 

Normal 

0.886298 

0.0112 

Reject 

Non-Normal 

Non-Normal 

R/R 

0.758739 

0.0001 

Reject 

Non-Normal 

0.932030 

0.1082 

Accept 

Normal 

Non-Normal 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

0.974257 

0.7715 

Accept 

Normal 

0.581358 

0.0001 

Reject 

Non-Normal 

Non-Normal 

TNMCM 

0.936315 

0.1350 

Accept 

Normal 

0.935154 

0.1271 

Accept 

Normal 

Normal 

MC 

0.948752 

0.2546 

Accept 

Normal 

0.962586 

0.4925 

Accept 

Normal 

Normal 
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Appendix  F  -  Variance  Test  Results 


20FW: 


Levene  Homogeneity  of  Variance  Test  | 

20FW 

Result  1 

Variable 

F-Ratio 

p-value 

Null 

Equality 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

5.2295 

0.0269 

Reject 

UnEqual 

FHA 

1.8780 

0.1772 

Accept 

Equal 

SFA 

0.0526 

0.8196 

Accept 

Equal 

FSE 

13.0663 

0.0007 

Reject 

UnEqual 

MSE 

5.5959 

0.0223 

Reject 

UnEqual 

HUTE 

2.9697 

0.0916 

Accept 

Equal 

SUTE 

0.5609 

0.4577 

Accept 

Equal 

P 

R 

S  0 

0  D 

R  U 

T  C 

E  1 

0 

N 

FR 

2.3622 

0.1312 

Accept 

Equal 

AR 

0.5333 

0.4689 

Accept 

Equal 

BR 

7.5820 

0.0084 

Reject 

UnEqual 

CR 

0.0816 

0.7764 

Accept 

Equal 

RC 

0.1780 

0.6571 

Accept 

Equal 

RP 

0.5671 

0.4553 

Accept 

Equal 

H 

F 

E 

A 

E 

E 

H 

APA 

24.2805 

0.0001 

Reject 

UnEqual 

DD 

1.0716 

0.3060 

Accept 

Equal 

R/R 

0.0448 

0.8333 

Accept 

Equal 

RCP 

0.0102 

0.9199 

Accept 

Equal 

MMH 

5.6130 

0.0221 

Reject 

UnEqual 

TNMCM 

1.2705 

0.2655 

Accept 

Equal 

MC 

3.2306 

0.0788 

Accept 

Equal 

1  Variance  Analysis  | 

1  20FW  1 

1  Group  1 

1  Change  | 

Result 

Pre 

Post 

Desired 

Actual 

DEV 

6.6 

2.4 

▼ 

T 

Decreased 

0  B 

FHA 

98969.6 

268425.6 

▼ 

A 

Increased 

E  L 

SFA 

44119.5 

52635.0 

▼ 

A 

Increased 

A  N 

FSE 

57.3 

17.5 

▼ 

T 

Decreased 

L  C 

MSE 

13.9 

7.2 

▼ 

T 

Decreased 

L  E 

HUTE 

12.6 

61.3 

▼ 

A 

Increased 

SUTE 

7.3 

11.6 

▼ 

A 

Increased 

FR 

20.4 

29.2 

▼ 

A 

Increased 

S  O 

AR 

0.6 

10 

▼ 

A 

Increased 

R  U 

BR 

1.9 

6.3 

▼ 

A 

Increased 

T  C 

1  T 

CR 

6.1 

6.1 

▼ 

A 

Increased 

E  1 

O 

RC 

34.0 

28.4 

▼ 

T 

Decreased 

N 

RP 

19.4 

20.1 

▼ 

A 

Increased 

APA 

2.1 

57.9 

▼ 

A 

Increased 

DD 

0.3 

0.2 

▼ 

T 

Decreased 

E 

R/R 

2.3 

2.2 

▼ 

T 

Decreased 

E 

RCP 

0.9 

11 

▼ 

A 

Increased 

^  T 

T 

MMH 

47.1 

171.4 

▼ 

A 

Increased 

TNMCM 

2.3 

2.9 

▼ 

A 

Increased 

2.1 

4.1 

▼ 

A 

Increased 
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27FW: 


Levene  Homogeneity  of  Variance  Test  | 

27FW 

Result  I 

Variable 

F-Ratio 

p-value 

Null 

Equality 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

2.3236 

0.1343 

Accept 

Equal 

FHA 

0.8647 

0.3573 

Accept 

Equal 

SFA 

0.0335 

0.8557 

Accept 

Equal 

FSE 

0.5581 

0.4588 

Accept 

Equal 

MSE 

2.9592 

0.0921 

Accept 

Equal 

HUTE 

0.4775 

0.4930 

Accept 

Equal 

SUTE 

0.0313 

0.8603 

Accept 

Equal 

P 

R 

S  0 

0  D 

R  U 

T  C 

1  T 

E  1 

0 

N 

FR 

0.7435 

0.3930 

Accept 

Equal 

AR 

0.2340 

0.6309 

Accept 

Equal 

BR 

0.0105 

0.9189 

Accept 

Equal 

CR 

6.4540 

0.0145 

Reject 

UnEqual 

RC 

1.9866 

0.1654 

Accept 

Equal 

RP 

2.1307 

0.1512 

Accept 

Equal 

F 

E 

A 

E 

E 

T 

T 

APA 

7.1605 

0.0103 

Reject 

UnEqual 

DD 

23.2530 

0.0001 

Reject 

UnEqual 

R/R 

4.1619 

0.0471 

Reject 

UnEqual 

RCP 

0.8527 

0.3606 

Accept 

Equal 

MMH 

2.0101 

0.1630 

Accept 

Equal 

TNMCM 

1.4249 

0.2387 

Accept 

Equal 

MC 

0.5589 

0.4585 

Accept 

Equal 

I  Variance  Analysis  | 

27FW 

I  Group  I 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

DEV 

8.9 

3.1 

T 

T 

Decreased 

0  B 

FHA 

51179.0 

78880.9 

T 

A 

Increased 

V  A 

E  L 

SFA 

32938.0 

29005.7 

T 

T 

Decreased 

R  A 

FSE 

37.9 

47.9 

T 

A 

Increased 

L  C 

MSE 

11.1 

4.7 

T 

T 

Decreased 

L  E 

HUTE 

14.8 

19.7 

T 

A 

Increased 

SUTE 

9.9 

9.7 

T 

T 

Decreased 

FR 

18.3 

26.1 

T 

A 

Increased 

S  O 

AR 

0.9 

1.1 

T 

A 

Increased 

R  U 

BR 

2.9 

2.6 

T 

T 

Decreased 

T  C 

I  T 

CR 

13.9 

4.4 

T 

T 

Decreased 

E  I 

O 

RC 

1.2 

0.7 

T 

T 

Decreased 

N 

RP 

1.5 

0.6 

T 

T 

Decreased 

APA 

23.9 

6.6 

T 

T 

Decreased 

DD 

1.4 

28.3 

T 

A 

Increased 

E 

R/R 

3.3 

1.6 

T 

T 

Decreased 

A 

E 

RCP 

3.9 

1.9 

T 

T 

Decreased 

^  T 

MMH 

75.7 

156.6 

T 

A 

Increased 

TNMCM 

7.5 

6.1 

T 

T 

Decreased 

MC 

9.1 

12.2 

T 

A 

Increased 
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388FW: 


Levene  Homogeneity  of  Variance  Test  | 

388FW 

Result  1 

Variable 

F-Ratio 

p-value 

Null 

Equality 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

0.0024 

0.9608 

Accept 

Equal 

FHA 

2.4911 

0.1213 

Accept 

Equal 

SFA 

0.6108 

0.4385 

Accept 

Equal 

FSE 

0.0000 

0.9991 

Accept 

Equal 

MSE 

14.7145 

0.0004 

Reject 

UnEqual 

HUTE 

3.4453 

0.0828 

Accept 

Equal 

SUTE 

0.3120 

0.5791 

Accept 

Equal 

P 

R 

S  0 

0  D 

R  U 

T  C 

1  T 

E  1 

0 

N 

FR 

2.4410 

0.1502 

Accept 

Equal 

AR 

0.7061 

0.4051 

Accept 

Equal 

BR 

3.6057 

0.0639 

Accept 

Equal 

CR 

0.1155 

0.7355 

Accept 

Equal 

RC 

0.8712 

0.3555 

Accept 

Equal 

RP 

1.8763 

0.1774 

Accept 

Equal 

F 

E 

A 

E 

E 

T 

T 

APA 

8.8737 

0.0046 

Reject 

UnEqual 

DD 

3.9676 

0.0523 

Accept 

Equal 

R/R 

0.1384 

0.7116 

Accept 

Equal 

RCP 

0.7856 

0.3800 

Accept 

Equal 

MMH 

3.2951 

0.0760 

Accept 

Equal 

TNMCM 

0.6540 

0.4228 

Accept 

Equal 

MC 

0.5033 

0.4816 

Accept 

Equal 

1  Variance  Analysis  | 

388FW 

1  Group  1 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

DEV 

8.0 

6.7 

▼ 

T 

Decreased 

0  B 

FHA 

103147.5 

210355.9 

▼ 

A 

Increased 

E  L 

SFA 

68821.0 

48870.1 

▼ 

▼ 

Decreased 

R  A 

FSE 

109.6 

121.9 

▼ 

A 

Increased 

L  C 

MSE 

40.1 

6.2 

▼ 

▼ 

Decreased 

L  E 

HUTE 

20.1 

46.4 

▼ 

A 

Increased 

SUTE 

14.0 

11.2 

▼ 

▼ 

Decreased 

R 

FR 

27.9 

44.2 

▼ 

A 

Increased 

S  O 

AR 

1.6 

3.5 

▼ 

A 

Increased 

R  y 

BR 

2.7 

1.1 

▼ 

▼ 

Decreased 

T  C 

CR 

11.6 

13.2 

▼ 

A 

Increased 

E  1 

O 

RC 

0.2 

0.3 

T 

A 

Increased 

N 

RP 

0.4 

0.3 

T 

▼ 

Decreased 

APA 

11.5 

4.0 

▼ 

▼ 

Decreased 

DD 

1.0 

3.8 

▼ 

A 

Increased 

E 

R/R 

0.9 

0.8 

▼ 

▼ 

Decreased 

E 

RCP 

1.8 

1.3 

▼ 

▼ 

Decreased 

T 

MMH 

90.5 

232.3 

▼ 

A 

Increased 

TNMCM 

8.1 

5.4 

▼ 

▼ 

Decreased 

MC 

9.5 

11.8 

▼ 

A 

Increased 
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22ARW; 


Levene  Homogeneity  of  Variance  Test  | 

22ARW 

Result  1 

Variable 

F-Ratio 

p-value 

Null 

Equality 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

FHA 

7.7658 

0.0077 

Reject 

UnEqual 

SFA 

8.2662 

0.0061 

Reject 

UnEqual 

FSE 

n/a 

n/a 

n/a 

n/a 

MSE 

0.8469 

0.3622 

Accept 

Equal 

HUTE 

12.9418 

0.0008 

Reject 

UnEqual 

SUTE 

13.9349 

0.0005 

Reject 

UnEqual 

P 

R 

S  0 

0  D 

R  U 

T  C 

1  T 

E  1 

0 

N 

FR 

0.8586 

0.3590 

Accept 

Equal 

AR 

0.3862 

0.5374 

Accept 

Equal 

BR 

1.2615 

0.2672 

Accept 

Equal 

CR 

0.2946 

0.5899 

Accept 

Equal 

RC 

1.5159 

0.2245 

Accept 

Equal 

RP 

0.3467 

0.5589 

Accept 

Equal 

F 

E 

A 

E 

E 

T 

T 

APA 

1.3019 

0.2598 

Accept 

Equal 

DD 

14.7372 

0.0004 

Reject 

UnEqual 

R/R 

0.0156 

0.9012 

Accept 

Equal 

RCP 

n/a 

n/a 

n/a 

n/a 

MMH 

1.1628 

0.2865 

Accept 

Equal 

TNMCM 

1.5863 

0.2142 

Accept 

Equal 

MC 

3.6942 

0.0608 

Accept 

Equal 

1  Variance  Analysis  | 

22ARW 

1  Group  1 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

V  A 

E  L 

R  A 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

36133.5 

452812.4 

T 

A 

Increased 

SFA 

1604.3 

14415.4 

T 

A 

Increased 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

46.6 

41.1 

T 

T 

Decreased 

HUTE 

47.1 

258.8 

T 

A 

Increased 

SUTE 

2.6 

9.6 

T 

A 

Increased 

S  O 

O  D 

R  U 

T  C 

1  T 

E  1 

O 

FR 

590.1 

370.3 

T 

T 

Decreased 

AR 

0.3 

0.3 

T 

T 

Decreased 

BR 

1.4 

2.3 

T 

A 

Increased 

CR 

12.4 

13.8 

T 

A 

Increased 

RC 

0.4 

0.5 

T 

A 

Increased 

RP 

0.3 

0.4 

T 

A 

Increased 

E 

A 

E 

E 

T 

T 

APA 

8.9 

11.9 

T 

A 

Increased 

DD 

4.0 

0.8 

T 

T 

Decreased 

R/R 

1.1 

1.2 

T 

A 

Increased 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

46.1 

32.8 

T 

T 

Decreased 

TNMCM 

9.3 

5.8 

T 

T 

Decreased 

MC 

15.3 

5.6 

T 

T 

Decreased 

96 


92ARW; 


Levene  Homogeneity  of  Variance  Test  | 

92ARW 

Result  1 

Variable 

F-Ratio 

p-value 

Null 

Equality 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

FHA 

35.7209 

0.0001 

Reject 

UnEqual 

SFA 

31.5822 

0.0001 

Reject 

UnEqual 

FSE 

n/a 

n/a 

n/a 

n/a 

MSE 

n/a 

n/a 

n/a 

n/a 

HUTE 

23.5965 

0.0001 

Reject 

UnEqual 

SUTE 

18.8987 

0.0001 

Reject 

UnEqual 

P 

R 

S  0 

0  D 

R  U 

T  C 

1  T 

E  1 

0 

N 

FR 

2.1709 

0.1475 

Accept 

Equal 

AR 

0.1845 

0.6696 

Accept 

Equal 

BR 

1.5672 

0.2169 

Accept 

Equal 

CR 

0.2508 

0.6189 

Accept 

Equal 

RC 

1.5822 

0.2215 

Accept 

Equal 

RP 

1.1942 

0.2802 

Accept 

Equal 

F 

E 

A 

E 

E 

T 

T 

APA 

17.6866 

0.0001 

Reject 

UnEqual 

DD 

1.0653 

0.3074 

Accept 

Equal 

R/R 

0.3473 

0.5585 

Accept 

Equal 

RCP 

n/a 

n/a 

n/a 

n/a 

MMH 

0.4059 

0.5272 

Accept 

Equal 

TNMCM 

2.5714 

0.1157 

Accept 

Equal 

MC 

8.8783 

0.0046 

Reject 

UnEqual 

1  Variance  Analysis  | 

92ARW 

1  Group  1 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

27332.6 

471878.0 

T 

A 

Increased 

SFA 

1431.9 

14815.9 

T 

A 

Increased 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

n/a 

n/a 

n/a 

n/a 

n/a 

HUTE 

40.7 

354.1 

T 

A 

Increased 

SUTE 

1.6 

10.2 

T 

A 

Increased 

R 

S  O 

O  D 

R  U 

T  C 

1  T 

E  1 

O 

FR 

242.5 

417.8 

T 

A 

Increased 

AR 

0.8 

16 

T 

A 

Increased 

BR 

3.1 

5.0 

T 

A 

Increased 

CR 

14.0 

24.3 

T 

A 

Increased 

RC 

1.0 

0.6 

T 

T 

Decreased 

RP 

1.1 

0.7 

T 

T 

Decreased 

E 

A 

E 

E 

T 

T  ^ 

APA 

6.1 

32.6 

T 

A 

Increased 

DD 

0.9 

2.5 

T 

A 

Increased 

R/R 

2.1 

15 

T 

T 

Decreased 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

48.8 

63.4 

T 

A 

Increased 

TNMCM 

10.1 

4.2 

T 

T 

Decreased 

MC 

136.2 

8.5 

T 

T 

Decreased 
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319ARW: 


Levene  Homogeneity  of  Variance  Test  | 

319ARW 

Result  1 

Variable 

F-Ratio 

p-value 

Null 

Equality 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

FHA 

17.1541 

0.0001 

Reject 

UnEqual 

SFA 

7.1155 

0.0105 

Reject 

UnEqual 

FSE 

n/a 

n/a 

n/a 

n/a 

MSE 

15.4322 

0.0003 

Reject 

UnEqual 

HUTE 

19.7579 

0.0001 

Reject 

UnEqual 

SUTE 

8.5803 

0.0053 

Reject 

UnEqual 

P 

R 

S  0 

0  D 

R  U 

T  C 

I  T 

E  I 

0 

N 

FR 

0.1562 

0.6945 

Accept 

Equal 

AR 

0.0236 

0.8786 

Accept 

Equal 

BR 

8.1233 

0.0065 

Reject 

UnEqual 

CR 

12.1974 

0.0011 

Reject 

UnEqual 

RC 

0.6780 

0.4145 

Accept 

Equal 

RP 

3.5180 

0.0671 

Accept 

Equal 

F 

E 

A 

E 

E 

T 

T 

APA 

10.3999 

0.0023 

Reject 

UnEqual 

DD 

0.7545 

0.3896 

Accept 

Equal 

R/R 

3.4497 

0.0697 

Accept 

Equal 

RCP 

n/a 

n/a 

n/a 

n/a 

MMH 

0.5836 

0.4488 

Accept 

Equal 

TNMCM 

0.8412 

0.3638 

Accept 

Equal 

MC 

1.5567 

0.2185 

Accept 

Equal 

1  Variance  Analysis  | 

319ARW 

1  Group  1 

I  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

V  A 

E  1. 

R  A 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

63317.6 

407567.8 

T 

A 

Increased 

SFA 

2788.2 

11811.1 

T 

A 

Increased 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

122.8 

340.1 

▼ 

A 

Increased 

HUTE 

33.5 

365.7 

▼ 

A 

Increased 

SUTE 

1.7 

11.8 

▼ 

A 

Increased 

R 

S  O 

O  D 

R  U 

T  C 

1  T 

E  1 

O 

FR 

584.5 

407.6 

▼ 

T 

Decreased 

AR 

0.3 

0.8 

▼ 

A 

Increased 

BR 

4.6 

1.5 

▼ 

T 

Decreased 

CR 

14.6 

4.1 

▼ 

T 

Decreased 

RC 

1.0 

0.3 

▼ 

T 

Decreased 

RP 

2.0 

0.8 

▼ 

T 

Decreased 

E 

A 

E 

E 

T 

T 

APA 

19.1 

8.0 

▼ 

T 

Decreased 

DD 

1.0 

1.6 

T 

A 

Increased 

R/R 

5.2 

1.4 

T 

T 

Decreased 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

16.3 

48.8 

T 

A 

Increased 

TNMCM 

12.7 

10.4 

T 

T 

Decreased 

MC 

19.7 

13.3 

T 

T 

Decreased 
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Appendix  G  -  Comparison  of  Means  Analysis  Results 


20FW: 


20FW 

M  eans  C ompariso n  Test  | 

Variable 

Normality 

Variance 

Test  Used 

F-Ratio  orX^ 

p-value 

Null 

Result 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

Normal 

UnEqual 

Welch 

18.4064 

0.0001 

Reject 

Significant 

FHA 

Non-Normal 

Equal 

Wilcoxon 

6.0208 

0.0141 

Reject 

Significant 

SFA 

Normal 

Equal 

ANOVA  F 

7.7200 

0.0079 

Reject 

Significant 

FSE 

Non-Normal 

UnEqual 

Wilcoxon 

2.6878 

0.1011 

Accept 

Not  Significant 

MSE 

Non-Normal 

UnEqual 

Wilcoxon 

11.0936 

0.0009 

Reject 

Significant 

HUTE 

Non-Normal 

Equal 

Wilcoxon 

0.0086 

0.9260 

Accept 

Not  Significant 

SUTE 

Normal 

Equal 

ANOVA  F 

2.1434 

0.1500 

Accept 

Not  Significant 

P 

R 

S  0 

0  D 

R  U 

T  C 

1  T 

E  1 

0 

N 

FR 

Non-Normal 

Equal 

Wilcoxon 

4.3816 

0.0363 

Reject 

Significant 

AR 

Normal 

Equal 

ANOVA  F 

15.7552 

0.0003 

Reject 

Significant 

BR 

Normal 

UnEqual 

Welch 

10.2569 

0.0029 

Reject 

Significant 

CR 

Normal 

Equal 

ANOVA  F 

0.1068 

0.7453 

Accept 

Not  Significant 

RC 

Non-Normal 

Equal 

Wilcoxon 

4.8500 

0.0276 

Reject 

Significant 

RP 

Non-Normal 

Equal 

Wilcoxon 

3.4275 

0.0641 

Accept 

Not  Significant 

H 

F 

E 

A 

E 

E 

T 

T 

H 

APA 

Non-Normal 

UnEqual 

Wilcoxon 

17.9037 

0.0001 

Reject 

Significant 

DD 

Non-Normal 

Equal 

Wilcoxon 

23.6301 

0.0001 

Reject 

Significant 

R/R 

Normal 

Equal 

ANOVA  F 

4.0309 

0.0506 

Accept 

Not  Significant 

RCP 

Non-Normal 

Equal 

Wilcoxon 

1.0464 

0.3063 

Accept 

Not  Significant 

MMH 

Non-Normal 

UnEqual 

Wilcoxon 

36.5672 

0.0001 

Reject 

Significant 

TNMCM 

Normal 

Equal 

ANOVA  F 

0.0007 

0.9787 

Accept 

Not  Significant 

MC 

Normal 

Equal 

ANOVA  F 

32.4060 

0.0784 

Accept 

Not  Significant 

1  M  eans  Analysis  | 

20FW 

1  Group  1 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

DEV 

7.6 

5.0 

▼ 

▼ 

Improved 

O  B 

FHA 

2233.8 

2031.8 

A 

▼ 

Degraded 

E  L 

SFA 

1389.6 

1213.2 

A 

T 

Degraded 

A  » 

FSE 

82.6 

86.4 

A 

A 

Improved 

L  C 

MSE 

93.1 

96.4 

A 

A 

Improved 

L  E 

HUTE 

26.1 

27.7 

A 

A 

Improved 

SUTE 

17.8 

16.5 

A 

▼ 

Degraded 

FR 

84.7 

81.3 

A 

T 

Degraded 

S  O 

AR 

4.2 

5.3 

▼ 

A 

Degraded 

O  D 

BR 

11.5 

13.4 

▼ 

A 

Degraded 

T  C 

1  T 

CR 

8.7 

8.9 

▼ 

A 

Degraded 

E  1 

O 

RC 

11.0 

8.1 

▼ 

T 

Improved 

RP 

10.7 

8.3 

▼ 

T 

Improved 

APA 

85.5 

77.3 

A 

T 

Degraded 

DD 

2.3 

1.5 

▼ 

T 

Improved 

E 

R/R 

4.8 

3.9 

▼ 

T 

Improved 

E 

RCP 

3.3 

3.4 

▼ 

A 

Degraded 

^  T 

T 

MMH 

39.7 

58.0 

▼ 

A 

Degraded 

TNMCM 

9.9 

9.9 

▼ 

A 

Degraded 

83.7 

84.7 

A 

A 

Improved 
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27FW: 


27FW 

M  eans  Compariso n  Test  | 

Variable 

Normality 

Variance 

Test  Used 

F-Ratio  orX^ 

p-value 

Null 

Result 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

Non-Normal 

Equal 

Wilcoxon 

35.2825 

0.0001 

Reject 

Significant 

FHA 

Normal 

Equal 

ANOVA  F 

0.1173 

0.6757 

Accept 

Not  Significant 

SFA 

Normal 

Equal 

ANOVA  F 

0.5843 

0.4485 

Accept 

Not  Significant 

FSE 

Normal 

Equal 

ANOVA  F 

29.6632 

0.0001 

Reject 

Significant 

MSE 

Non-Normal 

Equal 

Wilcoxon 

0.6309 

0.4270 

Accept 

Not  Significant 

HUTE 

Normal 

Equal 

ANOVA  F 

i.m8 

0.2996 

Accept 

Not  Significant 

SUTE 

Normal 

Equal 

ANOVA  F 

0.7376 

0.3949 

Accept 

Not  Significant 

P 

R 

S  0 

0  D 

R  U 

T  C 

E  1 

0 

N 

FR 

Normal 

Equal 

ANOVA  F 

10.9956 

0.0018 

Reject 

Significant 

AR 

Normal 

Equal 

ANOVA  F 

0.2182 

0.6427 

Accept 

Not  Significant 

BR 

Normal 

Equal 

ANOVA  F 

9.9224 

0.0029 

Reject 

Significant 

CR 

Non-Normal 

UnEqual 

Wilcoxon 

2.4568 

0.1170 

Accept 

Not  Significant 

RC 

Normal 

Equal 

ANOVA  F 

0.7117 

0.4032 

Accept 

Not  Significant 

RP 

Normal 

Equal 

ANOVA  F 

5.3577 

0.0251 

Reject 

Significant 

H 

F 

E 

A 

E 

E 

T 

H 

APA 

Normal 

UnEqual 

Welch 

34.3865 

0.0001 

Reject 

Significant 

DD 

Non-Normal 

UnEqual 

Wilcoxon 

0.2876 

0.5917 

Accept 

Not  Significant 

R/R 

Normal 

UnEqual 

Welch 

4.0724 

0.0501 

Accept 

Not  Significant 

RCP 

Non-Normal 

Equal 

Wilcoxon 

11.8 -^2 

0.0006 

Reject 

Significant 

MMH 

Non-Normal 

Equal 

Wilcoxon 

0.7863 

0.3752 

Accept 

Not  Significant 

TNMCM 

Non-Normal 

Equal 

Wilcoxon 

28.3118 

0.0001 

Reject 

Significant 

MC 

Non-Normal 

Equal 

Wilcoxon 

28.6388 

0.0001 

Reject 

Significant 

I  M  eans  Analysis  | 

27FW 

I  Group  I 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

V  A 

E  L 

R  A 

L  C 

L  E 

DEV 

14.5 

6.6 

T 

▼ 

Improved 

FHA 

1527.8 

1496.8 

A 

▼ 

Degraded 

SFA 

1076.8 

1038.0 

A 

▼ 

Degraded 

FSE 

67.1 

77.4 

A 

A 

Improved 

MSE 

95.9 

97.0 

A 

A 

Improved 

HUTE 

25.4 

24.2 

A 

▼ 

Degraded 

SUTE 

17.7 

17.0 

A 

▼ 

Degraded 

S  O 

O  D 

R  U 

T  C 

I  T 

E  I 

O 

FR 

74.0 

78.5 

A 

A 

Improved 

AR 

6.1 

6.2 

T 

A 

Degraded 

BR 

8.8 

10.3 

T 

A 

Degraded 

CR 

11.3 

9.4 

T 

▼ 

Improved 

RC 

3.7 

3.5 

T 

▼ 

Improved 

RP 

3.2 

2.5 

T 

▼ 

Improved 

E 

A 

E 

E 

T 

T 

APA 

58.4 

65.0 

A 

A 

Improved 

DD 

4.3 

6.6 

T 

A 

Degraded 

R/R 

6.8 

5.9 

T 

▼ 

Improved 

RCP 

4.9 

3.5 

T 

▼ 

Improved 

MMH 

35.1 

39.8 

T 

A 

Degraded 

TNMCM 

15.3 

9.5 

T 

▼ 

Improved 

MC 

76.9 

84.5 

A 

A 

Improved 
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388FW: 


388FW 

M  eans  Compariso n  Test  | 

Variable 

Normality 

Variance 

Test  Used 

F-Ratio  orX^ 

p-value 

Null 

Result 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

Normal 

Equal 

ANOVA  F 

15.3764 

0.0003 

Reject 

Significant 

FHA 

Non-Normal 

Equal 

Wilcoxon 

7.9800 

0.0047 

Reject 

Significant 

SFA 

Normal 

Equal 

ANOVA  F 

1.5687 

0.2167 

Accept 

Not  Significant 

FSE 

Non-Normal 

Equal 

Wilcoxon 

0.5980 

0.4394 

Accept 

Not  Significant 

MSE 

Non-Normal 

UnEqual 

Wilcoxon 

15.9306 

0.0001 

Reject 

Significant 

HUTE 

Normal 

Equal 

ANOVA  F 

2.8450 

0.0984 

Accept 

Not  Significant 

SUTE 

Normal 

Equal 

ANOVA  F 

0.1367 

0.7133 

Accept 

Not  Significant 

P 

R 

S  0 

0  D 

R  U 

T  C 

E  1 

0 

N 

FR 

Normal 

Equal 

ANOVA  F 

0.7341 

0.3960 

Accept 

Not  Significant 

AR 

Non-Normal 

Equal 

Wilcoxon 

5.9794 

0.0145 

Reject 

Significant 

BR 

Normal 

Equal 

ANOVA  F 

5.9294 

0.0188 

Reject 

Significant 

CR 

Non-Normal 

Equal 

Wilcoxon 

0.0027 

0.9589 

Accept 

Not  Significant 

RC 

Non-Normal 

Equal 

Wilcoxon 

0.0068 

0.9340 

Accept 

Not  Significant 

RP 

Non-Normal 

Equal 

Wilcoxon 

0.1805 

0.6709 

Accept 

Not  Significant 

H 

F 

E 

A 

E 

E 

T 

H 

APA 

Normal 

UnEqual 

Welch 

171.9524 

0.0001 

Reject 

Significant 

DD 

Non-Normal 

Equal 

Wilcoxon 

8.1101 

0.0044 

Reject 

Significant 

R/R 

Normal 

Equal 

ANOVA  F 

0.0577 

0.8112 

Accept 

Not  Significant 

RCP 

Non-Normal 

Equal 

Wilcoxon 

10.3031 

0.0013 

Reject 

Significant 

MMH 

Normal 

Equal 

ANOVA  F 

34.1408 

0.0001 

Reject 

Significant 

TNMCM 

Normal 

Equal 

ANOVA  F 

36.2057 

0.0001 

Reject 

Significant 

MC 

Normal 

Equal 

ANOVA  F 

69.5427 

0.0001 

Reject 

Significant 

I  M  eans  Analysis  | 

388FW 

I  Group  I 

I  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

0  B 

E  L 

R  A 

L  C 

L  E 

DEV 

10.6 

7.5 

▼ 

T 

Improved 

FHA 

1483.0 

1830.6 

▲ 

A 

Improved 

SFA 

1056.7 

1144.4 

A 

A 

Improved 

FSE 

73.3 

75.7 

A 

A 

Improved 

MSE 

90.7 

96.4 

A 

A 

Improved 

HUTE 

24.9 

27.7 

A 

A 

Improved 

SUTE 

17.7 

17.3 

A 

T 

Degraded 

R 

S  O 

0  D 

R  U 

T  C 

E  I 

O 

FR 

71.1 

72.7 

A 

A 

Improved 

AR 

5.7 

7.1 

T 

A 

Degraded 

BR 

9.0 

10.0 

T 

A 

Degraded 

CR 

10.2 

10.6 

▼ 

A 

Degraded 

RC 

1.3 

1.3 

T 

A 

Degraded 

RP 

1.4 

1.4 

T 

T 

Improved 

E 

E 

E 

APA 

59.6 

70.2 

A 

A 

Improved 

DD 

3.6 

2.8 

T 

▼ 

Improved 

R/R 

2.7 

2.6 

T 

▼ 

Improved 

RCP 

2.8 

4.0 

T 

A 

Degraded 

MMH 

37.0 

58.4 

T 

A 

Degraded 

TNMCM 

•B.T 

14.2 

T 

T 

Improved 

MC 

72.8 

80.6 

A 

A 

Improved 
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22ARW; 


22ARW 

M  eans  Comparison  Test  | 

Variable 

Normality 

Variance 

Test  Used 

F-Ratio  orX^ 

p-value 

Null 

Result 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

Non-Normal 

UnEqual 

Wilcoxon 

35.2653 

0.0001 

Reject 

Significant 

SFA 

Non-Normal 

UnEqual 

Wilcoxon 

28.4201 

0.0001 

Reject 

Significant 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

Non-Normal 

Equal 

Wilcoxon 

6.2816 

0.0122 

Reject 

Significant 

HUTE 

Normal 

UnEqual 

Welch 

22.3872 

0.0001 

Reject 

Significant 

SUTE 

Normal 

UnEqual 

Welch 

0.0785 

0.7811 

Accept 

Not  Significant 

P 

R 

S  0 

0  D 

R  U 

T  C 

1  T 

E  1 

0 

N 

FR 

Normal 

Equal 

ANOVA  F 

10.5320 

0.0022 

Reject 

Significant 

AR 

Non-Normal 

Equal 

Wilcoxon 

6.4414 

0.0111 

Reject 

Significant 

BR 

Normal 

Equal 

ANOVA  F 

0.1144 

0.7367 

Accept 

Not  Significant 

CR 

Normal 

Equal 

ANOVA  F 

11.3631 

0.0015 

Reject 

Significant 

RC 

Non-Normal 

Equal 

Wilcoxon 

17.8213 

0.0001 

Reject 

Significant 

RP 

Normal 

Equal 

ANOVA  F 

2.8329 

0.0991 

Accept 

Not  Significant 

H 

F 

E 

A 

E 

E 

T 

T 

H 

APA 

Normal 

Equal 

ANOVA  F 

126.8722 

0.0001 

Reject 

Significant 

DD 

Normal 

UnEqual 

Welch 

0.1119 

0.7402 

Accept 

Not  Significant 

R/R 

Non-Normal 

Equal 

Wilcoxon 

13.7289 

0.0002 

Reject 

Significant 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

Normal 

Equal 

ANOVA  F 

■^.9858 

0.0003 

Reject 

Significant 

TNMCM 

Non-Normal 

Equal 

Wilcoxon 

0.0895 

0.7648 

Accept 

Not  Significant 

MC 

Non-Normal 

Equal 

Wilcoxon 

1.3103 

0.2523 

Accept 

Not  Significant 

1  M  eans  Analysis  | 

22ARW 

1  Group  1 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

V  A 

E  L 

R  A 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

1562.8 

2876.2 

A 

A 

Improved 

SFA 

389.5 

541.3 

A 

A 

Improved 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

91.4 

85.9 

A 

T 

Degraded 

HUTE 

56.1 

73.0 

A 

A 

Improved 

SUTE 

13.5 

13.7 

A 

A 

Improved 

R 

S  O 

O  D 

R  U 

T  C 

1  T 

E  1 

O 

FR 

59.2 

38.7 

A 

T 

Degraded 

AR 

0.9 

0.5 

T 

T 

Improved 

BR 

2.8 

3.0 

T 

A 

Degraded 

CR 

13.1 

9.6 

T 

T 

Improved 

RC 

0.8 

1.9 

T 

A 

Degraded 

RP 

0.8 

1.2 

T 

A 

Degraded 

E 

A 

E 

E 

T 

APA 

29.2 

39.7 

A 

A 

Improved 

DD 

8.2 

8.0 

T 

T 

Improved 

R/R 

1.5 

2.8 

T 

A 

Degraded 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

20.3 

13.3 

T 

T 

Improved 

TNMCM 

10.3 

9.9 

T 

T 

Improved 

MC 

85.0 

84.7 

A 

T 

Degraded 
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92ARW; 


92ARW 

M  eans  Comparison  Test  | 

Variable 

Normality 

Variance 

Test  Used 

F-Ratio  orX^ 

p-value 

Null 

Result 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

Normal 

UnEqual 

Welch 

37.5165 

0.0001 

Reject 

Significant 

SFA 

Normal 

UnEqual 

Welch 

25.2683 

0.0001 

Reject 

Significant 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

HUTE 

Normal 

UnEqual 

Welch 

3.3255 

0.0025 

Reject 

Significant 

SUTE 

Normal 

UnEqual 

Welch 

3.2087 

0.0833 

Accept 

Not  Significant 

P 

R 

S  0 

0  D 

R  U 

T  C 

E  1 

0 

N 

FR 

Normal 

Equal 

ANOVA  F 

1.5375 

0.2213 

Accept 

Not  Significant 

AR 

Non-Normal 

Equal 

Wllcoxon 

0.0153 

0.9014 

Accept 

Not  Significant 

BR 

Normal 

Equal 

ANOVA  F 

0.1275 

0.7227 

Accept 

Not  Significant 

CR 

Non-Normal 

Equal 

Wllcoxon 

5.8220 

0.0158 

Reject 

Significant 

RC 

Normal 

Equal 

ANOVA  F 

0.9971 

0.3232 

Accept 

Not  Significant 

RP 

Normal 

Equal 

ANOVA  F 

0.7368 

0.3951 

Accept 

Not  Significant 

H 

F 

E 

A 

E 

"  T 
"  H 

APA 

Non-Normal 

UnEqual 

Wllcoxon 

25.4292 

0.0001 

Reject 

Significant 

DD 

Non-Normal 

Equal 

Wllcoxon 

23.7241 

0.0001 

Reject 

Significant 

R/R 

Normal 

Equal 

ANOVA  F 

1.5871 

0.2141 

Accept 

Not  Significant 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

Non-Normal 

Equal 

Wllcoxon 

2.9300 

0.0870 

Accept 

Not  Significant 

TNMCM 

Normal 

Equal 

ANOVA  F 

13.0465 

0.0007 

Reject 

Significant 

MC 

Non-Normal 

UnEqual 

Wllcoxon 

5.7261 

0.0167 

Reject 

Significant 

I  M  eans  Analysis  | 

92ARW 

I  Group  I 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

E  L 

R  A 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

1106.5 

1989.8 

▲ 

A 

Improved 

SFA 

239.8 

370.6 

▲ 

A 

Improved 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

n/a 

n/a 

n/a 

n/a 

n/a 

HUTE 

42.7 

56.2 

▲ 

A 

Improved 

SUTE 

9.2 

10.4 

A 

A 

Improved 

R 

S  0 

O  D 

R  U 

T  C 

I  T 

E  I 

O 

FR 

54.4 

47.9 

A 

T 

Degraded 

AR 

1.2 

1.4 

T 

A 

Degraded 

BR 

5.4 

5.6 

T 

A 

Degraded 

CR 

9.4 

7.2 

T 

T 

Improved 

RC 

1.5 

1.2 

T 

T 

Improved 

RP 

1.8 

1.5 

T 

T 

Improved 

E 

A 

E 

E 

T 

T  ^ 

APA 

26.8 

36.0 

A 

A 

Improved 

DD 

4.2 

6.3 

T 

A 

Degraded 

R/R 

3.2 

2.8 

T 

T 

Improved 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

19.5 

16.6 

T 

T 

Improved 

TNMCM 

13.1 

10.4 

T 

T 

Improved 

MC 

79.6 

85.8 

A 

A 

Improved 
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319ARW: 


319ARW 

M  eans  Comparison  Test  | 

Variable 

Normality 

Variance 

Test  Used 

F-Ratio  orX^ 

p-value 

Null 

Result 

0  B 

V  A 

E  L 

R  A 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

Non-Normal 

UnEqual 

Wllcoxon 

25.9392 

0.0001 

Reject 

Significant 

SFA 

Normal 

UnEqual 

Welch 

44.3496 

0.0001 

Reject 

Significant 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

Non-Normal 

UnEqual 

Wllcoxon 

16.8818 

0.0001 

Reject 

Significant 

HUTE 

Normal 

UnEqual 

Welch 

11.8108 

0.0019 

Reject 

Significant 

SUTE 

Normal 

UnEqual 

Welch 

4.7194 

0.0380 

Reject 

Significant 

P 

R 

S  0 

0  D 

R  U 

T  C 

E  I 

0 

N 

FR 

Normal 

Equal 

ANOVA  F 

0.7848 

0.3803 

Accept 

Not  Significant 

AR 

Non-Normal 

Equal 

Wllcoxon 

7.8845 

0.0050 

Reject 

Significant 

BR 

Norma! 

UnEqual 

Welch 

0.1323 

0.7182 

Accept 

Not  Significant 

CR 

Non-Normal 

UnEqual 

Wllcoxon 

18.9475 

0.0001 

Reject 

Significant 

RC 

Non-Normal 

Equal 

Wllcoxon 

0.0038 

0.9505 

Accept 

Not  Significant 

RP 

Non-Normal 

Equal 

Wllcoxon 

0.2665 

0.6057 

Accept 

Not  Significant 

H 

F 

E 

A 

E 

"  T 
"  H 

APA 

Non-Normal 

UnEqual 

Wllcoxon 

32.8713 

0.0001 

Reject 

Significant 

DD 

Non-Normal 

Equal 

Wllcoxon 

2.3970 

0.1216 

Accept 

Not  Significant 

R/R 

Non-Normal 

Equal 

Wilcoxon 

0.1792 

0.6720 

Accept 

Not  Significant 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

Non-Normal 

Equal 

Wilcoxon 

3.1831 

0.0744 

Accept 

Not  Significant 

TNMCM 

Normal 

Equal 

ANOVA  F 

3.4697 

0.0689 

Accept 

Not  Significant 

MC 

Normal 

Equal 

ANOVA  F 

8.1456 

0.0065 

Reject 

Significant 

1  M  eans  Analysis  | 

319ARW 

I  Group  I 

1  Change  | 

Result 

Variable 

Pre 

Post 

Desired 

Actual 

O  B 

V  A 

E  L 

A  N 

L  C 

L  E 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

FHA 

1239.4 

2346.7 

A 

A 

Improved 

SFA 

261.2 

425.5 

A 

A 

Improved 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

MSE 

96.7 

76.8 

A 

T 

Degraded 

HUTE 

46.2 

60.2 

A 

A 

Improved 

SUTE 

9.1 

10.8 

A 

A 

Improved 

R 

S  O 

O  D 

T  C 

I  T 

E  I 

O 

FR 

41.0 

46.7 

A 

A 

Improved 

AR 

0.6 

1.3 

▼ 

A 

Degraded 

BR 

3.9 

3.7 

▼ 

T 

Improved 

CR 

11.4 

6.6 

▼ 

T 

Improved 

RC 

1.1 

0.9 

▼ 

T 

Improved 

RP 

1.4 

1.3 

▼ 

T 

Improved 

E 

E 

E 

T 

T 

APA 

27.6 

39.6 

A 

A 

Improved 

DD 

6.0 

5.7 

▼ 

T 

Improved 

R/R 

2.5 

2.2 

T 

T 

Improved 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

MMH 

11.4 

10.7 

▼ 

T 

Improved 

TNMCM 

12.5 

10.7 

▼ 

T 

Improved 

MC 

81.0 

84.3 

A 

A 

Improved 
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F-16 

I  Variance  Focused  Plot  Summary 

+V,+M 

+V,=M 

+V,-M 

=V,+M 

=V,=M 

=V,-M 

-V,+M 

-V,=M 

-V,-M 

Variable 

20FW  I  27FW  3B8FW 

20FW  I  27FyV  I  383FW 

20FW  I  27F=W  I  388FW 

20FW  I  27FW  I  388FW 

20FW  I  27FW  I  388FW 

20FW  27FW  I  388FW 

20I=W  27FW  I  388FW 

20FW  I  27FW  I  388FW 

20FW  27FW  I  388FW 

KC-135 


Appendix  I  -  Trend  Analysis  Results 


20FW: 


Slope  Determination  Results  y  =  Po  +  Pi  +  £ 

.  vv 

Pre-Combat  Wing  Strueture 

Post-Combat  Wing  Stmeture 

Variable 

Po 

Pi 

Po 

Pi 

DEV 

10.823551 

-0.0257217 

4.05577971 

0.0748696 

O  B 

V  A 

E  |_ 

FHA 

2070.4185 

13.071522 

2394.0888 

-28.98243 

SFA 

1247.7065 

11.353478 

1260.3007 

-3.767391 

R  A 

A  N 

FSE 

75.966304 

0.5266957 

85.884058 

0.0406087 

L  C 

L  E 

MSE 

92.008333 

0.084 

97.720652 

-0.109652 

HUTE 

24.464493 

0.1311739 

31.606159 

-0.315826 

SUTE 

15.971739 

0.1472609 

16.473188 

0.0034783 

P 

FR 

82.855072 

0.1492609 

83.397101 

-0.170435 

R 

S  0 

AR 

4.623913 

-0.030913 

4.8101449 

0.0365217 

O  D 

R  U 

BR 

10.857971 

0.0526957 

16.307246 

-0.232913 

T  C 

1  T 

CR 

12.131522 

-0.276522 

11.977899 

-0.245565 

E  1 

0 

N 

RC 

9.8804348 

0.0895652 

11.181159 

-0.247826 

RP 

12.742754 

-0.166087 

12.782609 

-0.362609 

APA 

84.541304 

0.0796957 

85.678986 

-0.666652 

DD 

2.9105072 

-0.047174 

1.8391304 

-0.02913 

L 

R/R 

4.9844203 

-0.017087 

4.9981884 

-0.087522 

■-  A 

RCP 

3.1605072 

0.0148261 

3.717029 

-0.024696 

T  H 

MMH 

40.73913 

-0.08133 

71.48442 

-1.081087 

TNMCM 

8.4648551 

0.1114783 

10.082246 

-0.016913 

MC 

84.566304 

-0.066304 

84.013768 

0.0515652 
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20FW 

Trend  Comparison  Results  y  = 

Po  +  Pi  +  Oo  +  Cli  +  s 

Variable 

Po 

Pi 

ai 

(X2 

a2  p-value 

DEV 

7.4396739 

-0.091174 

1.3083333 

-0.166043 

0.0001 

0  B 

V  A 

E  L 

FHA 

2232.2536 

-7.955457 

101.00208 

21.026978 

0.0171 

SFA 

1254.0036 

3.7930435 

88.208333 

7.5604348 

0.1009 

R  A 

A  N 

FSE 

80.925181 

0.2836522 

-1.920833 

0.2430435 

0.0447 

L  C 

L  E 

MSE 

94.864493 

-0.012826 

-1.645833 

0.0968261 

0.1588 

HUTE 

28.035326 

-0.092326 

-0.7777083 

0.2235 

0.0792 

SUTE 

16.222464 

0.0753696 

0.6479167 

0.0718913 

0.2634 

P 

FR 

83.126087 

-0.010587 

1.7270833 

0.1598478 

0.1292 

R 

S  0 

AR 

4.717029 

0.0028043 

-0.514583 

-0.033717 

0.0745 

0  D 

R  U 

BR 

13.582609 

-0.090109 

-0.939583 

0.1428043 

0.0002 

T  C 

1  T 

CR 

12.05471 

-0.261043 

-0.116667 

-0.015478 

0.6607 

E  1 

0 

N 

RC 

10.530797 

-0.07913 

1.4583333 

0.1686957 

0.1521 

RP 

12.762681 

-0.264348 

1.2083333 

0.0982609 

0.2525 

APA 

85.110145 

-0.293478 

4.0958333 

0.3731739 

0.0002 

DD 

2.3748188 

-0.038152 

0.4229167 

-0.009022 

0.2808 

L 

R/R 

4.9913043 

-0.052304 

0.4333333 

0.0352174 

0.2534 

■-  A 

RCP 

3.4387681 

-0.004935 

-0.03125 

0.0197609 

0.3519 

T  H 

MMH 

56.111775 

-0.581109 

-9.122917 

0.4999783 

0.0119 

TNMCM 

9.2735507 

0.0472826 

-0.00625 

0.0641957 

0.052 

84.290036 

-0.00737 

-0.460417 

-0.058935 

0.1155 
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27FW: 


Slope  Determination  Results  y=P0  +  pi  +  s 

^  /  J 

.  vv 

Pre-Combat  Wing  Strueture 

Post-Combat  Wing  Stmeture 

Variable 

Po 

Pi 

Po 

Pi 

DEV 

16.882971 

-0.192304 

6.5271739 

0.0038261 

O  B 

V  A 

E  |_ 

FHA 

1390.1467 

11.014261 

1640.9373 

-11.52865 

SFA 

983.63768 

7.4556522 

1061.6739 

-1.893913 

R  A 

A  N 

FSE 

68.123188 

-0.083522 

80.136232 

-0.220565 

L  C 

L  E 

MSE 

98.042754 

-0.172087 

93.827536 

0.2511304 

HUTE 

21.563043 

0.3089565 

26.098551 

-0.155217 

SUTE 

14.473913 

0.260087 

16.969565 

-0.001565 

P 

FR 

73.939493 

0.0041739 

81.130797 

-0.21013 

R 

S  O 

AR 

6.2644928 

-0.013826 

5.7369565 

0.0390435 

O  D 

R  U 

BR 

8.9916667 

-0.015 

11.914855 

-0.128522 

T  C 

I  T 

CR 

11.353261 

-0.008261 

11.431884 

-0.159217 

E  1 

O 

N 

RC 

3.1532609 

0.0427391 

4.0956522 

-0.051652 

RP 

2.8101449 

0.0275217 

2.517029 

-0.003696 

APA 

64.557609 

-0.496609 

61.68587 

0.2611304 

DD 

5.8797101 

-0.123043 

13.403986 

-0.541652 

L 

R/R 

5.9876812 

0.0686522 

6.6402174 

-0.056217 

■-  A 

RCP 

3.9557971 

0.0758696 

2.0681159 

0.1172174 

T  H 

MMH 

45.556884 

-0.832217 

32.871377 

0.5549565 

TNMCM 

15.286594 

0.0037391 

11.135145 

-0.131478 

MC 

77.719203 

-0.06187 

81.489493 

0.2391739 
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27FW 

Trend  Comparison  Results  y  = 

pO  +  pi  +  aO  +  al  +  s 

Variable 

Po 

Pi 

ai 

(X2 

a2  p-value 

DEV 

11.705072 

-0.094239 

3.9520833 

-0.098065 

0.0472 

0  B 

V  A 

E  L 

FHA 

1515.542 

-0.257196 

15.497917 

11.271457 

0.0344 

SFA 

1022.6558 

2.7808696 

19.41667 

4.6747826 

0.2084 

R  A 

A  N 

FSE 

74.12971 

-0.152043 

-5.15 

0.0685217 

0.6204 

L  C 

L  E 

MSE 

95.935145 

0.0395217 

-0.5375 

-0.211609 

0.0001 

HUTE 

23.830797 

0.0768696 

0.6333333 

0.232087 

0.0061 

SUTE 

15.721739 

0.1292609 

0.3875 

0.1308261 

0.0364 

P 

FR 

77.535145 

-0.102978 

-2.25625 

0.1071522 

0.2801 

R 

S  0 

AR 

6.0007246 

0.0126087 

-0.066667 

-0.026435 

0.2065 

0  D 

R  U 

BR 

10.453261 

-0.071761 

-0.752083 

0.0567609 

0.0873 

T  C 

1  T 

CR 

11.392572 

-0.083739 

0.9041667 

0.0754783 

0.2307 

E  1 

0 

N 

RC 

3.6244565 

-0.004457 

0.11875 

0.0471957 

0.0198 

RP 

2.663587 

0.011913 

0.3416667 

0.0156087 

0.4738 

APA 

63.121739 

-0.117739 

-3.3 

-0.37887 

0.0001 

DD 

9.6418478 

-0.332348 

-1.145833 

0.2093043 

0.0006 

L 

R/R 

6.3139493 

0.0062174 

0.4541667 

0.0624348 

0.0565 

■-  A 

RCP 

3.0119565 

0.0965435 

0.6854167 

-0.020674 

0.534 

T  H 

MMH 

39.21413 

-0.13863 

-2.327083 

-0.693587 

0.0014 

TNMCM 

13.21087 

-0.06387 

2.9208333 

0.0676087 

0.2155 

79.604348 

0.0886522 

-3.766667 

-0.150522 

0.0242 

no 


388FW: 


Slope  Determination  Results  y=P0  +  pi  +  s 

X  vv 

Pre-Combat  Wing  Strueture 

Post-Combat  Wing  Stmeture 

Variable 

Po 

Pi 

Po 

Pi 

DEV 

10.321014 

0.0206522 

9.4960145 

-0.159348 

O  B 

V  A 

E  |_ 

FHA 

1161.1529 

25.746435 

1859.2928 

-2.294087 

SFA 

794.39855 

20.984783 

1084.7536 

4.7730435 

R  A 

A  N 

FSE 

71.454348 

0.1496522 

72.061594 

0.2877391 

L  C 

L  E 

MSE 

86.559058 

0.3346087 

95.973551 

0.0377826 

HUTE 

21.832609 

0.2413913 

28.147826 

-0.038826 

SUTE 

16.059783 

0.1312174 

16.388768 

0.0745652 

P 

FR 

74.523913 

-0.264913 

64.376449 

0.6652174 

R 

S  O 

AR 

6.6112319 

-0.073565 

7.6413043 

-0.045304 

O  D 

R  U 

BR 

9.6119565 

-0.049957 

10.351812 

-0.031478 

T  C 

I  T 

CR 

13.234058 

-0.239391 

14.828623 

-0.340957 

E  1 

O 

N 

RC 

1.2547101 

-0.000043 

1.667029 

-0.032696 

RP 

1.0463768 

0.0309565 

1.857971 

-0.039304 

APA 

54.479348 

0.4116522 

68.152536 

0.1621304 

DD 

4.051087 

-0.037087 

4.3634058 

-0.127739 

I 

R/R 

2.301087 

0.030913 

3.525 

-0.072 

A 

RCP 

3.2775362 

-0.04087 

3.2514493 

0.0622174 

T  H 

MMH 

46.584783 

-0.766783 

48.766667 

0.773 

TNMCM 

19.340942 

-0.048609 

16.834058 

-0.209391 

MC 

71.835507 

0.0738261 

76.191667 

0.354 
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388FW 

Trend  Comparison  Results  y  = 

po  +  pi  +  aO  +  al  +  s 

Variable 

Po 

Pi 

ai 

ai 

a2  p-value 

DEV 

9.9085145 

-0.069348 

1.5375 

0.09 

0.1109 

0  B 

V  A 

E  L 

FHA 

1510.2228 

11.726174 

-173.8167 

14.020261 

0.0858 

SFA 

939.57609 

12.878913 

-43.85417 

8.1058696 

0.0873 

R  A 

A  N 

FSE 

71.757971 

0.2186957 

-1.166667 

-0.069043 

0.7622 

L  C 

L  E 

MSE 

91.266304 

0.1861957 

-2.852083 

0.148413 

0.1299 

HUTE 

24.990217 

0.1012826 

-1.40625 

0.1401087 

0.2507 

SUTE 

16.224275 

0.1028913 

0.1895833 

0.0283261 

0.7038 

P 

FR 

69.450181 

0.2001522 

-0.739583 

-0.465065 

0.0001 

R 

S  0 

AR 

7.1262681 

-0.059435 

-0.691667 

-0.01413 

0.6679 

0  D 

R  U 

BR 

9.9818841 

-0.040717 

-0.485417 

-0.009239 

0.7496 

T  C 

1  T 

CR 

14.031341 

-0.290174 

-0.1625 

0.0507826 

0.406 

E  1 

0 

N 

RC 

1.4608696 

-0.01637 

-0.002083 

0.0163261 

0.1193 

RP 

1.4521739 

-0.004174 

0.0333333 

0.0351304 

0.0028 

APA 

61.315942 

0.2868913 

-0.5277083 

0.1247609 

0.0013 

DD 

4.2072464 

-0.082413 

0.4104167 

0.0453261 

0.1348 

L 

R/R 

2.9130435 

-0.020543 

0.03125 

0.0214565 

0.0048 

■-  A 

RCP 

3.2644928 

0.0106739 

-0.63125 

-0.051543 

0.048 

T  H 

MMH 

47.675725 

0.0031087 

-10.71458 

-0.769891 

0.003 

TNMCM 

18.0875 

-0.129 

2.2583333 

0.0803913 

0.1184 

74.013587 

0.213913 

-3.929167 

-0.140087 

0.0198 
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22ARW: 


00 

Slope  Determination  Results  y=P0  +  pi  +  s 

k_LVVV 

Pre-Combat  Wing  Strueture 

Post-Combat  Wing  Stmeture 

Variable 

Po 

Pi 

Po 

Pi 

DEV 

n/a 

n/a 

n/a 

n/a 

O  B 

V  A 

E  |_ 

FHA 

1408.0801 

12.381261 

2946.1543 

-5.593348 

SFA 

363.62681 

2.0665217 

509.40942 

2.553913 

R  A 

A  N 

FSE 

n/a 

n/a 

n/a 

n/a 

L  C 

L  E 

MSE 

97.243478 

-0.465478 

85.246739 

0.0552609 

HUTE 

56.09058 

0.003087 

64.714855 

0.6644783 

SUTE 

13.85942 

-0.028087 

10.968116 

0.2192174 

P 

FR 

87.009058 

-2.226391 

50.471739 

-0.945739 

R 

S  O 

AR 

1.0539855 

-0.011652 

0.1778986 

0.0264348 

O  D 

R  U 

BR 

2.5492754 

0.0233913 

1.0358696 

0.1551304 

T  C 

I  T 

CR 

9.1025362 

0.3191304 

13.496739 

-0.313739 

E  1 

O 

N 

RC 

0.7945652 

-0.003565 

1.9210145 

-0.014348 

RP 

0.9637681 

-0.013435 

1.548913 

-0.036913 

APA 

25.892391 

0.2626087 

44.923188 

-0.420522 

DD 

5.7213768 

0.1949565 

9.0300725 

-0.081739 

I 

R/R 

1.7583333 

-0.017 

3.4699275 

-0.051261 

A 

RCP 

n/a 

n/a 

n/a 

n/a 

T  H 

MMH 

14.918478 

0.4315217 

15.300362 

-0.160696 

TNMCM 

7.4793478 

0.2216522 

8.0934783 

0.1455217 

84.31087 

0.0541304 

84.556522 

0.0104783 
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22ARW 

Trend  Comparison  Results  y  = 

pO  +  pi  +  aO  +  al  +  s 

Variable 

Po 

Pi 

ai 

(X2 

a2  p-value 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

0  B 

V  A 

E  L 

FHA 

2177.1172 

3.3939565 

-656.6958 

8.9873043 

0.3941 

SFA 

436.51812 

2.3102174 

-75.9375 

-0.243696 

0.8972 

R  A 

A  N 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

L  C 

L  E 

MSE 

91.245109 

-0.205109 

2.74375 

-0.26037 

0.055 

HUTE 

60.402717 

0.3337826 

-8.445833 

-0.330696 

0.1997 

SUTE 

12.413768 

0.0955652 

-0.1 

-0.123652 

0.012 

P 

FR 

68.740399 

-1.586065 

10.264583 
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0.1074 

R 

S  0 

AR 

0.615942 

0.0073913 

0.2 

-0.019043 

0.1073 

0  D 

R  U 

BR 

1.7925725 

0.0892609 

-0.066667 

-0.06587 

0.0083 

T  C 

1  T 

CR 

11.299638 

0.0026957 

1.7583333 

0.3164348 

0.060502 

E  1 

0 

N 

RC 

1.3577899 

-0.008957 

-0.495833 

0.0053913 

0.706 

RP 

1.2563406 

-0.025174 

-0.145833 

0.0117391 

0.337 

APA 

35.40779 

-0.078957 

-5.245833 

0.3415652 

0.0001 

DD 

7.3757246 

0.0566087 

0.075 

0.1383478 

0.0001 

H 

F  E 

I 

R/R 

2.6141304 

-0.03413 

-0.641667 

0.0171304 

0.4487 

A 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

T  H 

MMH 

15.10942 

0.135413 

3.5104167 

0.2961087 

0.0219 

TNMCM 

7.786413 

0.183587 

0.16875 

0.0380652 

0.4621 

84.433696 

0.0323043 

0.15 

0.0218261 

0.7523 
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QO 

Slope  Determination  Results  y=P0  +  pi  +  s 

k_LVVV 

Pre-Combat  Wing  Strueture 

Post-Combat  Wing  Stmeture 

Variable 

Po 

Pi 

Po 

Pi 

DEV 

n/a 

n/a 

n/a 

n/a 

O  B 

V  A 

E  |_ 

FHA 

1025.8543 

6.4486522 

965.91884 

81.913826 

SFA 

219.13406 

1.6526087 

181.22464 

15.148696 

R  A 

A  N 

FSE 

n/a 

n/a 

n/a 

n/a 

L  C 

L  E 

MSE 

n/a 

n/a 

n/a 

n/a 

HUTE 

38.855435 

0.3105652 

37.318478 

1.5125217 

SUTE 

8.1887681 

0.0785652 

6.9221014 

0.2805652 

P 

FR 

71.42029 

-1.361957 

57.092754 

-0.736087 

R 

S  O 

AR 

1.0594203 

0.013913 

1.9202899 

-0.041957 

O  D 

R  U 

BR 

6.6721014 

-0.105435 

5.6521739 

-0.007174 

T  C 

I  T 

CR 

9.9210145 

-0.039348 

10.43442 

-0.261087 

E  1 

O 

N 

RC 

2.1539855 

-0.054652 

1.2905797 

-0.005913 

RP 
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-0.008174 

2.0344203 

-0.040087 
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-0.008565 

30.327174 
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DD 

3.0231884 

0.0944783 

7.1721014 
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L 

R/R 
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3.325 

-0.046 

■-  A 
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n/a 

n/a 

n/a 

n/a 

T  H 
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0.1045652 
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-0.851913 
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15.313768 

-0.173435 

9.7297101 
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67.042391 

1.0046087 

86.435145 

-0.053478 
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92ARW 

Trend  Comparison  Results  y  = 

pO  +  pi  +  aO  +  al  +  s 

Variable 

Po 

Pi 

ai 

(X2 

a2  p-value 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

0  B 

V  A 

E  L 

FHA 

995.88659 

44.181239 

-441.6896 

-37.73259 

0.0001 
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8.4006522 

-65.39583 

-6.748043 
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n/a 
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SUTE 
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-0.101 

0.0192 
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n/a 
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-0.111696 

0.0435 
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Slope  Determination  Results  y=P0  +  pi  +  s 

^  ±  jr 

^VVV 

Pre-Combat  Wing  Strueture 

Post-Combat  Wing  Stmeture 

Variable 

Po 

Pi 

Po 

Pi 

DEV 

n/a 

n/a 

n/a 

n/a 

O  B 

V  A 

E  |_ 

FHA 

1253.3409 

-1.116609 

1721.2272 

50.039826 

SFA 

251.81159 

0.7517391 

347.82246 

6.2108696 

R  A 

A  N 

FSE 

n/a 

n/a 

n/a 

n/a 

L  C 

L  E 

MSE 

90.798188 

0.4714783 

96.635507 

-1.587174 

HUTE 

44.303623 

0.1540435 

46.027899 

1.1374348 

SUTE 

8.1304348 

0.0795652 

8.9971014 

0.1405652 

P 

FR 

52.426449 

-0.916783 

27.556522 

1.5284783 

R 

S  O 

AR 

0.4945652 

0.0094348 

1.3576087 

-0.008609 

O  D 

R  U 

BR 

2.2003623 

0.1323043 

3.992029 

-0.025696 

T  C 

I  T 

CR 

10.722101 
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8.390942 

-0.145609 

E  1 
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N 

RC 

0.6014493 

0.0382174 

1.0235507 
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RP 

0.590942 
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1.6836957 
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R/R 
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E  L 
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n/a 

n/a 

n/a 

n/a 
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9.6427536 

0.228913 

10.280435 
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82.563406 

-0.126739 

84.255435 

0.0055652 
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319ARW 

Trend  Comparison  Results  y  = 

pO  +  pi  +  aO  +  al  +  s 

Variable 

Po 

Pi 

ai 

(X2 

a2  p-value 

DEV 

n/a 

n/a 

n/a 

n/a 

n/a 

0  B 

V  A 

E  L 

FHA 

1487.2841 

24.461609 

-553.6708 

-25.57822 

0.006 

SFA 

299.81703 

3.4813043 

-82.125 

-2.729565 

0.1145 

R  A 

A  N 

FSE 

n/a 

n/a 

n/a 

n/a 

n/a 

L  C 

L  E 

MSE 

93.716848 

-0.557848 

9.9479167 

1.0293261 

0.0005 

HUTE 

45.165761 

0.6457391 

-7.008333 

-0.491696 

0.0809 

SUTE 

8.5637681 

0.1100652 

-0.814583 

-0.0305 

0.5653 

P 

FR 

39.991486 

0.3058478 

-2.847917 

-1.22263 

0.0074 

R 

S  0 

AR 

0.926087 

0.000413 

-0.31875 

0.0090217 

0.577 

0  D 

R  U 

BR 

3.0961957 

0.0533043 

0.0916667 

0.079 

0.0262 

T  C 

1  T 

CR 

9.5565217 

-0.046522 

2.4041667 

0.099087 

0.1238 

E  1 

0 

N 

RC 

0.8125 

0.0135 
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0.1427 

RP 

1.1373188 

0.0163478 
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-0.05763 

0.4592 

DD 
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L 

R/R 
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■-  A 

RCP 

n/a 

n/a 

n/a 

n/a 

n/a 

T  H 

MMH 

11.564855 

-0.041522 
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0.2738261 

0.0208 

TNMCM 

9.9615942 

0.1302391 

0.9145833 

0.0986739 

0.1551 

83.40942 

-0.060587 

-1.672917 

-0.066152 

0.4433 
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Appendix  J  -  Time  Series  Plots 
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